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Abstract 


OPUS  (Optimal  Projection  for  Uncertain  Systems)  is  a  unified  ap¬ 
proach  to  control-system  design  and  analysis  for  high-performance, 
multivariable  applications  such  as  large  flexible  space  structures.  OPUS 
yields  low-order,  robust  controllers  that  meet  both  time-  and  frequency- 
domain  objectives.  This  final  report  discusses  progress  achieved  during 
the  previous  three  years  in  the  areas  of  robust  control,  fixed-structure 
control,  sampled-data  control,  tracking  control,  and  nonlinear  control. 


1  Introduction 

1.1  Overview  of  OPUS:  Scope,  Philosophy  and  Goals 

Over  the  past  10-15  years  controls  researchers  have  come  to  the  realization 
that  classical  controls  analysis  and  design  techniques  are  inadequate  in  the 
face  of  modern  large-sceile,  high-performamce  applications.  In  particular,  the 
principal  motivation  for  OPUS  (Optimal  Projection  for  Uncertain^Systems) 
is  the  problem  of  vibration  suppression  in  large  lightweight  flexible  space 
structures.  Such  systems  are  typically  characterized  by  high-dimensional, 
highly  uncertain  models  with  multiple  inputs  and  outputs.  In  addition, 
strmgent  performance  specifications  in  the  face  of  high  disturbance  levels 
place  severe  demands  on  existing  control-design  techniques.  Specifically, 
performance  tradeo&  involving  sensors,  processors,  actuators,  and  identifi¬ 
cation  accuracy  must  be  cut  as  tightly  as  possible  to  minimize^hardware  and 
testing  costs.  For  feasibility  and  cost  effectiveness,  system  design  must  also 
be  performed  efficiently  with  respect  to  human  and  computer  resources. 

The  goal  of  OPUS  is  to  develop  a  mathematically  rigorous,  unified 
control-design  methodology  that  directly  addresses  these  technology  issues.^ 
In  particular,  optimal  projection  theory  addresses  the  need  for  low-order, 
high-performance  controllers  that  can  be  implemented  on-board  for  real¬ 
time  operation.  Low-order  controllers  are  necessitated  by  cost,  weight,  and 
reliability  constraints  associated  with  speice-qualified  processors.  Further¬ 
more,  OPUS  incorporates  a  fundamental  theory  of  robust  controller  syn¬ 
thesis  to  account  for  unavoidable  modeling  uncertainties  arising  for  reasons 
such  as  material  and  manufacturing  variations,  thermal  and  aging  effects, 
and  limited  identification  surcuracy  in  a  1-g  environment.  The  principal 
contribution  of  OPUS  is  a  unified  design  methodology  that  simultaneously 

*See  Appendbc  A  for  an  extensive  review  of  OPUS 
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accounta  for  both  rcal*timo  procosnor  <:on«trainti  and  modoling  uncertainty. 
Under  t!m  program  OPUS  hoa  been  extended  to  a  large  clasa  of  problems 
in  ayatemo  and  control  theory.  The  current  scope  of  the  theory  includes 

1.  Reduced-order  modeling,  catimation  and  control; 

2.  Ilobust  estimation  and  control  via  quadratic  Lyapunov  functions 
including  robust  performance; 

3.  A  unified  approach  to  and  Hqo  control; 

4.  A  general  theory  of  fixed-structure  control; 

5.  Extensions  to  sarnplcd-data  and  decentralized  control. 

Ono  goal  of  OPUS  is  to  capture  as  many  desit-t'  constraints  as  poesiblo 
v/ithin  a  single  system  of  design  equations.  Of  particular  interest  is  recent 
extensions  to  Hoo  design.  As  shown  in  [1.29]  (Appendix  B),  we  have  devel¬ 
oped  a  method  for  directly  imbedding  Hoo  design  constraints  within  OPUS 
theory  and  thus,  in  particular,  within  LQG.  These  results  are  given  by  a 
system  of  modified  Riccati  equations  that  directly  generalize  LQG  theory 
and  that  have  the  potential  for  significant  computational  savings  compared 
to  existing  Hqo  synthesis  methods.  An  additional  example  is  provided  by  the 
results  obtained  in  [1.20,1.30,1.35,1.43]  (Appendix  D)  for  both  robust  stabil¬ 
ity  and  robust  Hj  performance  via  fixed-order  compensation  in  the  presence 
of  parametric  uncertainty. 

There  are  several  justifications  for  this  line  of  research.  First,  and  most 
obvious,  is  the  fact  that  our  results  show  that  numerous  design  constraints 
can  be  captured  simultaneously  within  a  design  theory  that  directly  gen¬ 
eralizes  LQG  theory.  Such  an  approach  provides  the  capability  for  simul¬ 
taneously  perfornning  multiple  design  tradeofis  for  multivariable  feedback 
systems  with  respect  to  competing  constraints  such  as  sensor  noise,  con¬ 
trol  authority,  controller  order,  robustness,  disturbance  attenuation,  mean- 
square  error,  sample  rate,  degree  of  decentralization,  etc.  Next  wo  stress 
that  rather  than  being  ad  hoc  constructions,  these  design  equations  follow 
directly  from  the  optimality  of  physically  meaningful  well-defined  perfor¬ 
mance  criteria.  These  results  arc  thus  useful  in  assessing  the  suboptimality 
of  altern  itive  methods. 


Overall,  OPUS  can  be  viewed  as  a  theory  for  characterizing  solutions 
to  constrained  control-design  problems.  'IVansforming  OPUS  into  a  practi¬ 
cal  design  methodology  requires  the  development  of  effective  computational 
algorithms.  Such  development  has  been  in  progress  at  Harris  Corporation 
and  Florida  Institute  of  Technology  for  several  years  [1.23,1.41,11.117,11.124]. 
Using  homotopic  continuation  methods,  efficient  numerical  algorithms  have 
been  developed  that  account  for  the  structure  of  these  modified  Riccati 
equations  and  their  coupling  terms.  Homotopy  algorithms  offer  several  ad¬ 
vantages  over  both  gradient-based  and  Newton-type  methods.  For  example, 
homotopy  methods  have  a  strong  theoretical  foundation  based  upon  topo¬ 
logical  degree  theory,  while  in  practice  these  methods  address  the  issues 
of  startup,  convergence,  and  global  optimality.  Homotopy  algorithms ‘have 
also  reached  a  high  degree  of  maturity  and  availability  with  the  advent  of 
HOMPACK  described  in 

L.  T.  Watson,  S.  C.  Billups  and  A.  P.  Morgan,  “A  Suite  of  Codes 
for  Globally  Convergent  Homotopy  Algorithms,”  ACM  Trans. 

Math  Software,  Vol.  13,  pp.  281t310,  1987. 

1.2  Impact  of  OPUS  on  Related  Programs 

At  Harris,  OPUS  has  been  used  in  the  NASA  CSI  (Control-Structure  In¬ 
teraction)  program  administered  by  NASA  Langley  Research  Center.  As 
a  contractor  to  NASA  under  this  program,  Harris  has  implemented  robust 
optimal  projection  controllers  to  demonstrate  vibration  suppression  on  the 
ACES  testbed  at  Marshall  Space  Flight  Center  and  the  Minimast  structure 
at  NASA  Langley.  Details  of  these  experiments  can  be  found  in  [11.118]. 

Outside  of  Harris,  OPUS  has  been  applied  to  an  experimental  truss 
structure  at  Sandia  Laboratories.  As  described  in 

Peterson,  L.  D.,  Allen,  J.  J.,  Lauffer,  J.  P.,  and  Miller,  A.  K.,  “An 
Experimental  and  Analytical  Synthesis  of  Controller  Structure 
Design,”  Proceedings  of  the  SOth  Structures,  Structural  Dynam¬ 
ics,  and  Materials  Conference,  paper  89-1170,  Mobile,  AL,  April 
1989. 

Peterson,  L.  D.,  “An  Optimal  Projection  Controller  for  an  Ex¬ 
perimental  Truss  Structure,”  Proceedings  of  the  AIAA  Guidance, 
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Navigation,  and  Control  Conference,  Boston,  MA,. August  1989. 
pp.  77-88;  J.  Quid.  Contr.  Dyn.,  Vol.  14,  pp.  241-250, 1991. 

experimental  results  demonstrated  close  agreement  with  theorfrf.ical  predic¬ 
tions  for  low-order,  practically  implementable  'controllers.  There  are  also 
ongoing  programs  at  Sandia  that  are  utilizing  OPUS  for  active  vibration 
suppression.  In  fact,  Semdia  National  Laboratories  is  funding  the  develop¬ 
ment  at  Harris  of  advanced  homotopy  algorithms. 


1.3  Goals  of  this  Report 

This  report  has  two  main  objectives.  First,  we  shall  summarize  progress 
achieved  under  the  program  during  the  past  three  years.  Since  most  of  the 
technical  results  are  given  in  the  extensive  appendices,  we  sh2dl  only  sum¬ 
marize  these  results  and  remark  on  their  significance  and  interrelationship. 
Our  %cond  objective  is  to  describe  the  status  of  ongoing  research  activities. 


2  Robust  Control 

The  problem  of  robust  control  design  and  analysis  constitutes  a  sighifi- 
cemt  challenge  in  mathematical  systems  theory  which,  at  the  same  time, 
addresses  a  fundamental^  issue  iu  the  practical  implementation  of' feedback 
control,  systems,  namely,  modeling  uncertmnty.  Modeling  uncertainty  must 
be  charcicterized  and.  quantified  so  that  it  can  be  accounted  for  within  the 
control-design  process.  Furthermore,  a  controller  can  only  be  considered 
robust  when  it  is  guaranteed  to  provide  specified  stability  and  performance 
over  a  prescribed  set  of  uncertain  plant  variations. 

For  vibration  suppression  in  .flexible  structures,  modeling  uncertainty  is 
often  significant  and  thus  the  need  for  robust  control  may  be  severe. 

2.1  Hco  Control 

Strictly  speaking.  Hob  control  refers  to  the  problem  of  disturbance  atten¬ 
uation  with  L2  signal  norms  on  disturbances  and  performance  variables. 
The  induced  Hpo  transfer  function  norm  thus  corresponds  to  the  worst-case 
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disturbance  attenuation.  By  introducing  suitable  dynamic  weightings,  Hqo 
design  provides  the  means  for  loop  shaping  and  hence  stability  robustness. 

During  the  past  several  years  it  has  become  clear  that  suboptimal  Hqo 
design  can  be  performed  by  utilizing  algebraic  Riccati  equations.  In  [1.29] 
(Appendix  B)  we  formulated  a  fixed-order  control-design  problem  with  a 
constraint  on  the  Hqo  norm  of  the  closed-loop  transfer  function.  By  using 
an  algebraic  Riccati  equation  to  enforce  the  Hqo  constraint,  optimality  con¬ 
ditions  for  characterizmg  feedback  gains  that  n^imize  an  H2  cost  bound 
were  obtained.  The  results  derived  In  [1.29]  thus  address  both  H2  and  Hqo 
design  aspects.  This  result  provides  the  means  to  tradeofif  rms  (quadratic 
performance)  and  stability  robustness  to  unstructured  uncertainty. 

An  additional  feature  of  [1.29]  is  the  treatment  of  both  full-  and  reduced- 
order  controllers  via  optimal  projection  design.  Hence,  these  results  provide 
a  unified  setting  for  H2/Hoo/reduced-order  control  design.  The  extension 
to  reduced-order  control  is  useful  for  applications  in  which  high  plant  or¬ 
der  and  dynamic  weightings  would  otherwise  lead  to  excessively  high-order 
controllers. 

The  reduced-order  Hoo  design  results  have  been  extended  to  two  re¬ 
lated  problems,  namely,  H2/H00  model  reduction  and  H2/H00  estimation 
(see  [1.31]  and  [1.28]  in  Appendix  B).  For  the  control  problem,  the  results 
of  [1.29]  were  generalized  in  [1.45]  (see  Appendix  B)  to  include  additional 
aspects  such  as  disturbance/performance  feedthrough.  Finally,  the  relation¬ 
ship  between  the  H2  norm  bound  (an  entropy  functional)  and  the  H2  norm 
itself  is  explored  in  [1.40]  (Appendix  B). 

2.2  Robustness  with  Structured  Uncertainty 

Our  approach  to  robust  control  in  the  presence  of  structured  uncertainty 
was  originally  inspired  by  the  effects  of  multiplicative  white  noise  within  a 
linear-quadratic  optimization  problem.  Optimal  controllers  designed  in  the 
presence  of  such  disturbances,  it  was  reasoned,  are  automatically  desensi¬ 
tized  to  actual  plemt  parameter  variations.  This  idea  was  confirmed  empiri- 
cedly  by  numerical  studies  [1.5]  which  showed  an  efiicient  design  tradeoff  be¬ 
tween  performance  and  robustness  in  the  presence  of  structured  real-valued 
parameter  variations. 

What  was  lackmg,  however  was  a  rigorous  proof  that  such  controllers 
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are  guaranteed  to  be  robust  for  all  cases  in  which  the  design  equations  eure 
solvable.  This  issue  was  addressed  in  [1.13]  where  it  w^  shown  that  a  second- 
moment  stochastic  stability  condition  in  the  presence  of  a  time-exponential 
cost  weighting  induces  a  Lyapunov  function  that  guarantees  deterministic 
robust  stability  over  a  prescribed  range  of  parameter  variations.  This  result 
thus  provides  a  link  between  stochastic  optimal  control  and  deterministic 
robust  stability  theory. 

Although  robust  stability  is  extremely  important  in  applications,  it  is 
often  desirable  in  practice  to  obtain,  in  addition,  a  bound  on  worst-case 
performance  degradation  over  a  class  of  plzmt  perturbations.  To  this  end 
we  have  extended  optimal  projection  theory  to  encompass  the  problem  of 
robust  H2  performance.  Specifically,  as  shown  in  [1.30]  (Appendix  D),  the 
multiplicative  white  noise  model  yields,  in  addition,  a  bound  on  worst-case 
performemce. 

A  more  basic  problem  than  robust  synthesis  is  the  problem  of  robust 
analysis.  That  is,  given  a  particular  control  design,  determine  the  class  of 
perturbations  under  'which  the  closed-loop  system  remains  stable  along  with 
a  bound  on  worst-case  performance.  Results  for  this  problem  were  obtained 
in  [1.33]  (Appendix  C)  by  means  of  the  Lyapunov  equation 

0  =  AQ  +  QA^  +  n  +  V,  (1) 

where  is  a  fixed  matrix  that  provides  a  bound  for  perturbations  AA  of  A. 
A  related  idea  developed  in  [1.44]  (Appendix  C)  involves  replacing  12  by  an 
operator  n{Q)  resulting  in 

0  =  AQ  +  QA^  +  n{Q)  -b  V.  (2) 

The  operator  12  is  chosen  to  bound  terms  of  the  {oim'AAQ+QAA?^,  where 
AA  is  an  uncertain  perturbation  of  the  dynamics  matrix  A.  This  approach 
leads  to  an  a  priori  robustness  test,  i.e.,  a  "yes/no”  test  for  a  given  uncer¬ 
tainty  set  in  contreist  to  the  results  of  [1.33]  which  are  of  an  a  posteriori 
nature.  Using  (2)  also  unifies  several  approzu:hes  studied  in  the  literature 
for  control  design.  Specifically,  setting 

n{Q)  =  t;,6i\AiQ  +  QA^\,  (3) 

i=l 

where  |  •  [is  the  eigenvalue  absolute  value  operator,  corresponds  to  the 
approach  of 
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H,  li.  Chang  and  T.  IC  C.  Pong,  “Adaptive  Guarantood  Coat 
Control  of  Systems  with  Uncertain  Parameters,"  IEEE  Trana. 
Autom.  Contr.^  Vol.  AC-17,  pp.  474-483,  1972. 

while  the  quadratic  (in  tj?)  bound 

rtW)  =  D  +  QEQ,  (4) 

whicl)  ia  related  to  Hoo  theory,  was  studied  in 

I,  R.  Petersen  and  C.  V,  Hollot,  “A  Riccati  Ek^uation  Approach 
to  the  Stabilization  of  Uncertain  Systems,"  Automatiea,  Vol.  22, 
pp.  397-411,  1980. 

Furthermore,  the  linear  (in  Q)  bound 

tHQ)  =  '£,^tl.atQ  +  a:'AiQA[)  (6) 

<!=1 

corrc.'jpond3  to  the  multiplicative  white  noise  approach.  The  quadratic 
bound  (4)  and  the  linear  bound  (5)  were  developed  for  robust  controller 
eynthcais  in  [1.20]  and  [1.43],  respectively  (Appendix  D).  Both  the  linear 
and  quadratic  bounds  were  considered  within  the  context  of  Hoo  control  in 
[1.35]  (Appendix  D). 

In  general  these  bounds  are  sufficient  for  robust  stability  but,  except  in 
r  pccial  coses,  are  not  necessary.  Furthermore,  the  bounds  bold  for  com* 
plex  variations  as  well  thus  leading  to  additional  conservatism.  To  reduce 
this  conservatism  one  can  utilize  positivity  theory  and  the  circle  and  Popov 
criteria,  to  which  we  now  turn. 


2.3  Ilobiistnosg  to  Positive  Real  Uncertainty 

As  a  (Irnt  stop  in  reducing  the  small*gain>type  conservatism  of  quadratic  Lya^ 
punov  functions,  we  have  addressed  the  use  of  phase  information  in  robust 
analynifl  and  synthesis.  The  importance  of  addressing  phase  Information  in 
controlling  flexible  structures  and  its  relationship  to  real  parameter  uncer* 
tainty  are  discussed  in  [11.123]  (Appendix  M).  To  include  phase  information 
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in  the  modeling  of  imcertainty,  we  applied  the  Riccati  equation  characteriza¬ 
tion  of  positive  real  transfer  functions  due  to  Anderson  and  Vongpanitlerd  to 
a  robust  control  problem  involving  positive  real  uncertainty  [L54]  (Appendix 
M).  It  turns  out  that  the  Riccati  equation  that  guarantees  robust  stability 
for  positive  real  imcertainty  is  actually  a  quadratic  Lyapunov  bound  in  the 
sense  of  the  theory  developed  in  [1.44].  This  result  thus  unifies  small  gain 
and  positive  real  stability  robustness  analysis. 

These  results  have  also  been  extended  to  encompass  the  classical  Popov 
criterion  [62,64]  (Appendix  hQ.  The  prindpal  feature  of  these  results  is 
the  fact  that  they  are  based  upon  parameter-dependent  Lyapunov  func¬ 
tions  which  effectively  exclude  time-varying  parameter  perturbatiims.  Hence 
these  results  are  significantly  less  conservative  when  the  plant  uncertainty 
involves  constant  real  parameters..  The  results  of  [64]  encompass  full-state, 
full-order,  and  reduced-order  controller  ^thesis  in  H2  and  H2/H00  settings. 


3  Fixed-Structure  Control 

In  practical  control  dedgn  it  is  usually  necessary  to  focus  on  controllers  that 
satisfy  structural  constraints  such  as  compensator  order,  decentralizaticm, 
etc.  Several  aspects  of  the  fixed-structure  problem  are  discussed  in  this 
section. 


3.1  Finite-Dimensional  Control  of  Distributed  Parameter 
Systems 

Distributed  parameter  systems  such  as  large  flexible  structures  are  inher¬ 
ently  infinite  dimensional.  That  is,  it  is  not  generally  possible  to  specify  a 
‘Modeling  bandwidth’’  prior  to  the  controi-d^gn  process.  Implementable 
controllers,  in  contrast,  are  invariably  constrained  to  be  finite  dimensional 
and  preferably  of  as  low  order  as  posrible.  The  need  for  such  controllers 
was  discussed  at  length  in  [1.4],  where  the  optimal  projection  equations 
were  generalized  to  characterize  finite-dimensional,  fixed-order  controllers 
for  infinite-dimensional  systems.  This  result  provides  a  path  to  controller 
design  that  avoids  both  model  and  controller  reduction. 

The  usual  approach  to  finite-dimensional  controller  design  involves  con- 
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structing  a  sequence  of  full-order  controllers  for  a  sequence  of  plant  approx¬ 
imations  of  increasing  order.  The  drawback  to  such  an  appro^h  is  that 
for  a  given  controller  order  there  is  no  guarantee  that  the  corresponding 
controller  is  optimal  over  the  class  of  controllers  of  the  given  order,  thus 
yielding  controllers  of  unnecessarily  high  dimension  in  order  to  meet  perfor¬ 
mance  requirements. 

To  overcome  the  suboptimality  problem  and  to  limit  the  compensator 
order  in  accordance  with  implementation  constraints,  the  optimal  projection 
approach  can  be  used  to  constrain  the  controller  order  even  as  the  discretiza¬ 
tion  order  increases  [1.4].  This  approach  has  been  implemented  usmg  spline 
approximations  in  [1.42]  (Appendix  E).  For  a  heat  equation  /and  a  delay  sys¬ 
tem,  optimal  projection  designs  were  obtained.  For  the  heat  equation  these 
results  comprise  a  sequence  of  first-order  controllers  for  plant  discretizations 
up  to  32L\d  order.  These  results  should  be  contrasted  with  the  functional 
gains  ‘for  \ihe  same  example  which  require  considerably  greater  processor 
capacity  for  real-time  implementation  with  virtually  the  same  closed-loop 
performance. 


3.2  Controller  Complexity  Constraints 

In  control-system  design  it  is  often  desirable  to  implement  the  simplest  pos¬ 
sible  controller  for  achieving  performance  objectives.  By  ‘^simplest”  we  are 
referring  to  a  reduction  in  control  system  complexity  which  can  be  measured 
in  several  ways,  for  example: 

•  sensor/actuator  requirements  (throughput  and  memory) 

•  degree  of  decentralization  (sensor/actuator  communication) 

•  controller  memory  (dynamic  order  and  pole  location) 

•  control  law  logic  (mode  switching,  limit  checking,  and  fault  detection) 

To  address  the  issues  of  controller  complexity,  we  have  developed  a  the¬ 
ory  of  fixed-structure  design  that  permits  considerable  flexibility  in  assigning 
the  structure  of  the  controller  architecture.  This  approach  is  based  upon 
the  results  obtained  in  [11.89]  (Appendix  F)  which  shows  that  a  dynamic 
controller  of  arbitrary  structure  can  be  recast  as  a  static  output  feedback 
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controller  for  a  suitably  modified  plant.  The  static  output  feedback  prob- 
Iciii  has  a  highly  structured  form  not  considered  previously  in  the  literature, 
namely,  decentralized  control  allowing  for  the  repetition  of  gams  in  differ* 
ent  feedback  paths.  This  gain  repetition  provides  additional  flexibility  in 
addressing  problems  such  as  reliable  stabilization  of  multiple  plants. 

The  problem  defined  in  [11.80]  was  addressed  in  [11.01]  which  developed 
a  theory  of  H3/H00  control  design.  By  extending  results  obtained  earlier  for 
H2  decentralized  control  in  [1.34],  the  results  of  [II.Ol]  include,  in  addition, 
a  constraint  on  Hqo  performance.  The  key  feature  of  [II.Ol]  b  the  treat* 
ment  of  the  singular  feedback  control  gain  from  nonnoby  measurements  to 
unweighted  controls.  These  results  edso  clarify  relationships  with  singular 
control  theory  and,  in  particular,  the  singular  LQG  problem  to  which  wc 
now  turn. 


3.3  Singular  Control  Problems 

The  fixed'Structure  approach  provides  an  additional  tool  for  addressing  the 
longstanding  problem  of  singularities  in  optimal  feedback  design.  To  address 
the  singular  problem,  we  have  reexamined  the  simplest  possible  case,  namely 
full-state  feedback  with  totally  singular  control  weighting  [11.122]  (Appendix 
G).  To  better  understand  the  fixed-structure  approach  as  applied  to  thb  sin¬ 
gular  problem,  the  optimality  conditions  were  derived  in  [11.122]  by  means 
of  four  distinct  methods,  namely,  the  Goh  transformation,  a  perturbation 
method,  the  generalized  Legendre-Clebsch  conditions,  and  the  fixed  struc¬ 
ture  technique.  Applying  these  different  techniques  side-by-side  has  proven 
to  be  useful  in  illuminating  the  subtleties  of  thb  problem. 

The  advantage  of  the  fixed-structure  approach  over  the  other  techniques 
studied  in  [11.122]  b  the  ease  with  which  it  addresses  feedback  constraints. 
Thus  using  thb  technique  we  have  undertaken  a  renewed  attack  on  the 
singular  LQG  problem  [1.67]  (Appendix  G).  The  fixed  structure  approach 
also  provides  the  ability  to  limit  the  number  of  signal  differentiators  utilised 
in  the  feedback  controller. 

Finally,  the  fixed-structure  approach  extends  directly  to  the  Hj/Ho*, 
problem.  The  results  given  in  [11.54]  (Appendix  G)  represent  the  most  gen* 
oral  singular  Hqo  results  currently  available. 


lU 


3.<1  Pole  Placement 


As  an  additional  extension  of  Qxcd-structuro  design,  we  have  addreued  the 
problem  of  designing  feedback  compensators  with  constrained  pole  locations. 
The  basic  idea  is  to  extend  LQG  controller  design  to  include  a  constraint 
on  the  closed-loop  polos.  To  this  end  we  have  considered  static  and  dy¬ 
namic  compensation  with  a  variety  of  constraint  regions,  including  a  circle, 
ellipse,  parabola,  and  strip.  The  results  obtained  in  [1.55]  (Appendix  H) 
demonstrate  a  tradeoff  between  pole  location  for  transient  response  and 
steady-state  control  effort.  An  important  extension  for  future  research  is 
the  incorporation  of  eigenvector  construnts  as  well  to  achieve  disturbance 
decoupling. 


4  Sampled-Data  Control 

The  discussion  in  the  previous  sections  has  focused  on  continuous- time  sys¬ 
tems  subject  to  continuous-time  (analog)  controllers.  In  practice,  however, 
controller  implementation  will  almost  invariably  utilize  digital  controllers 
within  the  context  of  sampled-data  control  systems.  Rigorous  c^usideration 
of  such  systems  is  critical,  particularly  for  distributed  parameter  systems 
which  possess  modal  frequencies  beyond  the  Nyquist  rate  of  any  digital 
controller.  Hence,  a  rigorous  theory  of  sampled-data  control  design  must  be 
developed  that  accounts  precisely  for  all  effects  arising  from  analog-to-digital 
and  digital-to-analog  operations. 

Optimed  projection  theory  for  discrete-time  systems  was  developed  in 
[1.6]  and  applied  to  sampled-data  systems  in  [1.7].  As  a  next  step  it  is 
desirable  to  obtain  robust  control  results.  To  this  end,  the  optimal  pro¬ 
jection  equations  for  reduced-order  discrete-time  control  in  the  presence  of 
multiplicative  white  noise  were  obtained  in  [1. 10].  After  these  results  were 
obtained,  it  became  clear  that  a  true  sampled-data  robustness  theory  must 
account  for  the  special  matrix  structure  that  arises  from  the  sampling  pro¬ 
cess.  For  example,  if  A-\-AA  denotes  the  continuous-time  dynamics  matrix, 
where  A  is  the  nominal  matrix  and  AA  denotes  uncertainty,  then  the  equiv¬ 
alent  discrete-time  dynamics  matrix  is  given  by  where  h  is  the 

sample  interval.  Because  of  the  exponential,  however,  this  discrete-time  dy¬ 
namics  matrix  docs  not  have  the  form  considered  in  the  discrete-time  theory. 
Moreover,  a  finite  approximation  for  the  exponential  will  not  be  valid  in  the 
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presence  of  system  time  constants  near  or  above  the  sample  rate. 

One  attempt  to  bound  this  discrepancy  resulted  in  new  inequalities  in 
[1.19]  (Appendix  J),  while  an  alternative  approach  based  upon  quadratic 
Lyapunov  bounds  was  developed  in  [1.37]  (Appendix  J). 

In  practical  applications  there  arise  additional  sampled-data  effects  that 
must  also  be  eiccounted  for.  Specifically,  real  systems  invariably  involve 
multiple,  nonsynchronized  A/D  and  D/A  devices  working  at  different  rates 
within  the  context  of  a  decentralized  controller  architecture.  Preliminary 
analysis  of  several  such  cases  reveals  enormous  underlying  complexity  that 
must  be  accounted  for  in  designing  implementable  control  laws. 

Our  next  goal  is  the  problem  of  multirate  sampled-data  control.  As  a 
first  step  in  addressing  the  multirate  problem,  we  have  obtained  results  for 
multirate  estimation  [1.66]  (Appendix  J).  The  estimator  has  a  discrete>time 
periodic  structure  to  directly  account  for  the  multirate  timing  sequence  of 
the  measurements.  This  result  is  based  upon  a  discrete-time  periodic  star 
bility  condition  and  involves  a  coupled  system  of  Riccati  equations  corre¬ 
sponding  to  each  subinteryal  of  the  period.  Extensions  to  multirate  control 
are  in  progress. 


5  Tracking  Control 


The  theory  discussed  in  Sections  2-4  addresses  the  problem  of  feedback  con¬ 
trol  for  regulation  in  the  presence  of  stochastic  disturbances.  Many  control 
problems  are,  however,  of  a  tracking  or  servomechanism  nature.  While  a 
limited  class  of  such  problems  can  be  recast  without  loss  of  generality  as 
regulation  problems,  memy  important  ones  cannot.  For  example,  the  stan¬ 
dard  transformations  given  in 

H.  Kwakernaak  and  R.  Sivan,  Linear  Optimal  Control  Systems, 
Wiley,  New  York,  1972. 

B.  A.  Francis,  A  Course  m  Hoo  Control  Theory,  Springer- Verlag, 

New  York,  1987. 

assume  that  the  command  signals  can  be  represented  as  an  augmentation  of 
the  plant  dynamics.  There  are  many  important  cases,  such  as  the  tracking 
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of  steps  and  ramps,  that  must  be  represented  by  uncontrollable,  unstable 
(i.e.,  unstabilizable)  dynamics,  where  this  transformation  cannot  be  applied. 
Furthermore,  such  transformations  often  ignore  controller  effort. 

As  a  first  step  in  eiddressing  these  issues,  we  have  considered  the  problem 
of  regulation  about,  a  prescribed  nonzero  set  point,  which  corresponds  to 
the  step  command  tracking  problem.  Our  work  in  this  area  was  originally 
motivated  by  results  obtained  in 

Z.  Artstein  and  A.  Leizarowitz,  “l^acking  Periodic  Signals  with 
the  Overtaking  Criterion,”  IEEE  Trans.  Autom.  Contr.,  Vol. 
AC-30,  pp.  1123-1126, 1985. 

A.  Leizarowitz,  “Tiacking  Nonperiodic  Trajectories  with  the  Over¬ 
taking  Criterion,”  Appl.  Math.  Optim.,  Vol.  14,  pp.  155-171, 

1986. 

A.  Leizarowitz,  “Infinite  Horizon  Stochastic  Regulation  and  Track¬ 
ing  with  the  Overtaking  Criterion,”  Stochastics,  1987. 

References  [1.9,1.17,1.24]  (Appendix  I)  present  general  solutions  to  the  nonzero 
set  point  problem  for  static  and  dynamic  controllers.  Note  that  these  con¬ 
trollers  involve  two  components,  namely,  a  closed-loop  feedback  component 
similar  to  a  regulator  and  an  open-loop  feedforward  component  which  has 
no  cpunterpart  in  the  standard  theory  and  which  cannot  be  obtained  from 
standard  transformations. 

Recent  activities  have  focused  on  extending  the  nonzero  set  point  results 
to  broader  classes  of  command  and  disturbance  signeils.  It  turns  out  that  the 
challenging  case  (as  with  steps  and  ramps)  involves  signals  generated  by  un¬ 
stable  commmid  or  reference  dynamics.  As  a  critical  first  step  in  addressing 
this  problem  we  have  considered  the  problem  of  reduced-order  steady-state 
observer  design  for  unstable  plants  [1.38,1.47]  (Appendix  I).  Previous  results 
on  reduced-order  estimation  obtained  in  [1.2]  were  limited  to  stable  systems. 

Our  present  goal  is  to  extend  the  results  of  [1.47]  to  the  problem  of  com¬ 
mand  following  with  unstabilizable  dynamics.  This  result  involves  a  nontriv¬ 
ial  extension  of  the  results  of  [1.47]  to  incorporate  the  command  dynamics 
within  the  compensator  [11.143]  (Appendix  I). 
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6 


Nonlinear  Control 


6.1  Motivation 

In  view  of  the  requirements  of  control-system  practice,  we  are  primarily 
interested  in  developing  nonlinear  control-system  synthesis  methods  with 
the  following  attributes: 

•  yield  autompnous  (time-invariant)  controllers  for  siniplicity  of  imple¬ 
mentation 

•  yield  feedback  controllers  that  are  independent  of  initial  conditions  for 
disturbance  rejection  and  robustness 

•  yield  continuous  control  signals  to  avoid  impulsive  inputs 

Of  course  there  are  numerous  applications  in  whichrsome  or  all  of  the 
above  requirements  may  not  apply.  For  example,  a  precise  spacecraft  slewing 
maneuver  may  be  best  thieved  by  a  time-varying  finite-interval  control  law. 
obtained  by  solving  a  two-point  boundary  value  problem.  Nevertheless,  our 
requirements  lead  to  a  useful  class  of  implementable  feedback  controllers. 

There  currently  exist  a  variety  of  methods  for  synthesizing  nonlinear 
feedback  control  systems,  including  local  linearization,  global  linearization, 
variable  structure  control,  Lyapunov  function  techniques,  and  differential- 
geometric  methods.  Our  attention  is  focussed  primarily  on  optimality-based 
methods.  Specifically,  we  have  considered  synthesis  methods  that  yield  non¬ 
linear  feedback  controllers  as  a  consequence  of  minimizing  a  specified  per¬ 
formance  (cost)  functional.  A  principal  motivation  is  the  desire  to  extend 
linear  optimality-based  methods  such  as  LQG  and  Hoo  theory. 

In  practice,  optimality-based  design  theories  provide  the  ability  to  quan¬ 
tify  and  optimize  the  performance  of.the  closed-loop  system.  Moreover,  the 
structure  and  characteristics  of  the  feedback  control  law  arise  as  a  conse¬ 
quence  of  variational  principles  thus  providing  a  rigorous  foundation  for  the 
design  task.  Such  methods  often  provide  an  optimality  context  for  con¬ 
trollers  designed  by  other  methods. 

The  Maximum  Principle  is,  of  course,  an  optimality-based  result  which  is 
applicable  to  a  wide  range  of  time-varying,  nonlinear  plants.  However,  since 
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the  Maximum  Principle  does  not  generally  provide  feedback  controllers,  ro¬ 
bustness  in  the  presence  of  uncertainties  such  as  external  disturbances  and 
plant  modeling  errors  is  difficult  to  achieve.  Furthermore,  infinite-horizon 
controllers  (discussed  in  more  detml  below)  are  difficult  to  achieve.  Nev¬ 
ertheless,  the  Maximum  Principle  remains  within  our  sphere  of  interest 
both  for  its  fundamental  nature  and  for  its  connections  to  Hamilton- Jacobi- 
Bellman  theory  to  which  we  now  turn. 

6.2  HJB  Theory 

Hamilton- Jacobi-Bellman  theory  has  its  roots  in  the  classical  Hamilton- 
Jacobi  partial  differential  equation  as  well  as  the  dynamic  programming 
technique  of  Bellman.  In  its  most  general  form,  the  theory  involves  a  par¬ 
tial  differential  equation  whose  solution  yields  an  optimal  controller.  For 
practical  purposes  we  assume  analytic  data  with  an  infinite  horizon  cost 
criteria.  As  shown  in 

D.  L.  Lukes,  “Optimal  Regulation  of  Ncnlinear  Dynamical  Sys¬ 
tems,”  SIAM  J.  Contr.,  Vol.  AC-16,  pp.  87-88, 1971. 

under  these  assumptions  the  HJB  equation  has  an  analytic  solution 
which  is  Lyapunov  function  that  guarantees  global  stability  of  the  closed- 
loop  system.  Furthermore,  the  optimal  control  is  given  in  the  form  of  a 
feedback  law  which  is  independent  of  the  initial  condition.  A  simplified 
framework  for  this  theory  is  given  in  [1.57]  (Appendix  K).  Particular  atten¬ 
tion  is  paid  to  the  closed-form  solution  given  in 

R.  W.  Bass  and  R.  D.  Webber,  “Optimal  Nonlinear  Feedback 
Control  Derived  from  Quartic  find  Higher-Order  Performance 
Criteria,”  IEEE  Trans.  Atitom.  Contr.,  Vo;  AC-zl.  pp.  448- 
454, 1966. 

Connections  are  also  made  to  related  results  given  in 

J.  L  Speyer,  “A  Nonlinear  Control  Law  for  a  Stochastic  Infinite 
Time  Problem,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-21,  pp. 
560-564, 1976. 
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In  spite  of  the  appealing  nature  of  HJB  theory,  its  current  state  of  de¬ 
velopment  entails  several  limitations  in  -dressing  real-world  problems.  In 
particular,  these  include  1)  the  abiUty  t<»  static  and  dynamic  output- 
feedback  compensators;  2)  th^s  trcsr./  .^i  vL.  ■?  external  disturbances;  and  3) 
the  development  of  robust  contio.^-  .;t^n  plants.  Hence  one  of 

our  principal  goals  is  to  extend  the  state  of  the  theory  by  removing 

these  limitations. 

Our  first  goal  is  to  eliminate  the  r^  .  ment  that  the  full  state  be  avail¬ 
able  to  implement  the  feedback  law.  ?t,»  class, of  control  problems  that 

we  are  addressing  there  are  typic.?Jly  oni  *  a  small  number  of  measurements 
available  for  a  high-dimensional  plant.  An  indirect  solution  to  this  problem 
is  to  implement  an  estimator  to  reconstruct  the  state  from  the  available 
measurements.  However,  besides  being  a  diificult'problem  itself,  there  is 
no  reason  to  expect  that  certeunty  equivalence  (separation)  v/ill  hold  in  the 
presence  of  honlinearities.  Consequently,  wetmust  consider  the  problem  of 
designing  output-feedback  laws  that  are  pre-'constrained  to  operate  solely 
upon  the  available  measurements.  Such  controllers  may  be  either  static 
(proportional)  or  dynamic. 

To  achieve  this  goal  it  appears  naturd^io  develop  a.  fixed^atruelwe  HJB 
theory  in  which  one  can  prespecify  the  structure  of  the  ^edback  law  -with 
respect-  to,  say,  the  order  of  nonlinearities  appearing  in  the  dynamic  com¬ 
pensator.  The  actualgdiu-inaps  can  then  be  determined  by  solving  algebraic 
relations  in  much  the  same  way  full-state  feedback  controllers  are  obtained. 
Preliminary  results  in  this  direction  have  been  obtained  in 

J.  J.  Beaman,  “Nonlinear  Quadratic  Gaussian  Control,”  Int.  J. 

Contr.,  Vol.  39,  pp.  343-361,  1984. 

'  Another  limitation  of  most  existing  HJB  theory  is  the  lack  of  design 
results  in  the  presence  of  external  disturbances.  In  linear  control  theory 
such  disturbances  cein  be  modeled  as  additive  plant  disturbances,  and,  in  the 
case  of  output  feedback,  as  additive  sensor  noise.  The  treatment  of  external 
disturbances  is  possible  by  means  of  stochastic  HJB  theory,  although  with 
greater  complexity; 

When  the  performance  functional  /X(x,u)  involves  terms  of  order  x**, 
where  p  <  2,  then  we  call  the  cost  criterion  subqriadratic.  Subquadratic 
cost  criteria  pay  close  attention  to  the  behavior  of  the  state  near  the  origin 
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since,  for  example,  ®3  >>  a:^  for  a:  near  zero.  Our  interest  in  subquadratic 
cost  criteria  stems  from  the  fact  that  optima  controUers  for  such  criteria*  are 
sublinear  and  thus  exhibit  finite  scitling  time  behavior.  This  phenomenon 
has  been  studied  in 

S.  V.  Salehi  and  E.  P  Ryein,  “On  Optimal  Nonlinear  Feedback 
Regulation  of  Linear  Plants,”  lEEii  Trans.  Autom.  Contr.,  Yol. 
aC-27,  pp.  1260-1264;  19.'^2. 

V.  T.  Haimo,  “Finite  Time  Controllers,”  SIAM  J.  Contr.  Cn- 
tim.,  Vol.  24,  pp.  768-770,  1986. 

and  applied  to  spacecraft  control  in 

S.  V.  Salehi  and  E.  P.  Ryan,  “Optimal  Nonlinear  Feedback  Regu¬ 
lation  of  Spacecraft  Angular  Momentum.”  Optim.  Contr.  Appl. 
Meth.,  Vol.  5,  pp.  101-110, 1984. 

These  results  yield  finite  interval  controllers  even  though  the  original  cost 
criterion  was  defined  on  the  infinite  horizon.  Hence  one  advantage  of  this  ap¬ 
proach  for  certsdn  appUcations  is  to  obtain  finite-interval  controllers  without 
the  computation^  complexities  c  wo-point  boundary  value  problems.  We 
also  note  that  if  the  order  of  the  f  ubquadratic  state  terms  appearing  in  the 
cost  functional  is  sufficiently  small,  then  the  controllers  actually  optimize 
a'  minimum-time  cost  criterion.  Currently,  such  results  ue  only  obtidnable 
using  the  maximum  principle  which  generally  does  not  yield  feedback  con¬ 
trollers.  Hence  subquadratic  cost  criteria  permit  a  unified  treatment  of  a 
broad  r2uige  of  design  goads  and  provide  the  tools  for  developing  connections 
with  alternative  methods. 
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S,  the  closed-loop  system  is  stable;  U,  the  closed-loop  system  is  unstable. 

Only  the  optimal  projection  equations  yielded  stabilizing  controllers  in  every  case,  even  at  high 
authority. 
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Application  of  Maximum  Entropy/ Optimal  Projection 
Design  Synthesis  to  a  Benchmark  Problem 


Emmanuel  G.  Collins*,  James  A.  Kingt,  and  Dennis  S.  Bemsteint 
Harris  Corporation,  Melbourne,  Florida,  32901 


Maximum  Entropy/ Optimal  Projection  (ME/OP)  design  synthesis  is  a.  methodology 
for  designmg  robust,  fixed-order  controllers  for  flexible  structures.  This  paper  reviews  the 
theoretical  basis  for  ME/OP  and  illustrates  the  approach  usmg  a  benchmark  problem. 
The  benchmark  problem  involves  two  masses  with  spring  coupling,  an  uncertain  spring 
constant,  and  a  sensor  and  actuator  which  are  noncolocated. 


*  Associate  Principal  Engineer,  Government  Aerospace  Systems  Division 
t  Senior  Engmeer,  Government  Aerospace  Systems  Division 
^  Staff  Engineer,  Government  Aerospace  Systems  Division 


•  I.  Introduction 


Active  feedbzKJc  control  for  vibration  suppression  in  lightly  damped  structures  continues  to  be 
a  challenging  area  of  aerospace  engineering^.  Typically,  such  problems  involve  multi-input/multi¬ 
output  systems  in  noncolocated  sensor/actuator  configurations.  The  taisk  of  designing  disturbance 
attenuation  feedback  controllers  for  such  systems  is  further  exacerbated  by  constraints  on  real¬ 
time  processing  capacity  for  feedback  control  law  implementation  as  well  as  modeling  uncertainty 
associated  with  complex  structures.  Among  the  numerous  methodologies  proposed  for  addressing 
the  structured  control  problem,  this  paper  focusses  on  the  maximum  entropy/optimal  projection 
(ME/OP)  approach.  This  approach  was  originally  developed  by  Hyland  in  a  series  of  technical 
reports  and  conference  papers  (Refs.  2-6).  The  ME/OP  approach  has  been  applied  experimentally 
to  various  structural  control  testbeds^~^  and  has  been  evaluated  by  other  researchers  in  Refs. 
10-12.  Subsequently,  numerous  extensions  and  variations  of  this  approaudi  have  been  developed  to 
address  a  variety  of  problems  in  robust,  fixed-structure  controller  synthesis^^"^^.  A  detailed  review 
of  this  work  with  extensive  references  to  related  literature  is  given  in  Ref.  18. 

The  purpose  of  this  paper  is  twofold.  First  we  provide-(in  Sections  11  and  HI)  a  brief  review 
of  robust  fixed-order  controller  synthesis,  in  particular,  robust  optimal  projection  controller  syn¬ 
thesis.  Although  a  detailed  review  is  given  in  Ref.  13,  the  brief  review  given  here  focusses  more 
directly  on  the  ME/OP  technique  for  robust  controller  synthesis,  which  is  described  in  Section  HI. 
After  reviewing  ME/OP,  we  then  turn  our  attention  in  Section  IV  to  problems  #1  and  #3  of  the 
benchmark  example  given  in  Ref.  19.  The  ME/OP  design  approach  is  applied  to  the  benchmark 
example  in  Section  .V  and  the  design  results  are  discussed  in  Section  VI. 

n.  Robmt  Fixed-Order  Controller  Synthesis 

Optimal  projection  theory^’  generalizes  LQG  theory  to  the  case  of  reduced-order  controllers. 
While  LQG  theory  provides  quadratically  (H2)  optimal  full-order  dynamic  compensators  by  means 
of  two  uncoupled  Riccati  equations,  optimal  projection  theory  characterizes  quadraticdly  optimal 
reduced-order  (i.e.,  fixed-order)  controllers  via  a  coupled  system  consisting  of  two  modified  Ric¬ 
cati  equations  and  two  modified  Lyapunov  equations.  When  the  controller  order  is  set  equal  to 
the  plant  order,  the  idempotent  matrix  responsible  for  the  coupling  (the  so-called  “optimal  pro¬ 
jection”)  becomes  the  identity,  the  coupling  terms  vanish,  the  Lyapunov  equations  are  rendered 
superfluous,  and  the  LQG  Riccati  equations  are  recovered.  Numerical  algorithms  for  solving  the 
optimal  projection  equations  via  iterative  and  homotopy  techniques  have  been  developed  in  Refe. 


1 


20-22. 


Bobust  optimal  projection  theory  (as  well  as  robust  LQG  theory)  has  been  developed  by  in¬ 
corporating  imcertainty  bounds  within  the  deagn  optimization  procedure.  The  idea  behind  this 
approach  can  most  clearly  be  illustrated  within  the  context  of  robust  analysis,  while  its  application 
to  synthesis  is  a  fairly  strmghtforward  extension  of  fixed-structure  optimization.  The  description 
given  here  follows  the  development  of  uncertainty  boimds  given  in  Ref.  23. 

For  the  a^mptotically  stable  linear.system 

x(t)  =  Ax(t),  (1) 

we  consider  a  quadratic  Lyapunov  function  of  the  form 

=  (2) 

where  the  positive-definite  matrix  P  is  given  by  the  Lyapunov  equation 

0  =  A'^P  +  PA+R,  (3) 

where  R  is  positive  definite.  Li  order  to  address  additive  disturbances  for  a  system  of  the  form 

z(i)  =  Az(t)  -f-  u;(f),  (4) 

it  is  convenient  to  utilize  the  dual  equation 

Q  =  AQ-i-QA^  +  V  (5) 

in  which  A  is  replaced  by  (which  has  the  same  spectrum  as  A)  and  where  V  is  interpreted 
as  the  intensity  of  the  white  noise  disturbance  t<;(t).  In  (5),  the  matrix  Q  can  be  viewed  as  a 
controllability  Granuan  or  covariance  matrix  with  associated  quadratic  (Hj)  performance  measure 

J  =  tTQR  =  tTPV.  (6) 

If  A  is  uncertain  so  that  (l)  is  replaced  by 

s(0  =  (A-f  AA)i(0,  (7) 

where  AA  6  U,  a  set  of  perturbations,  then  we  wish  to  determine  whether  A-f  AA  remains  stable 
for  all  AA  6  U.  One  approach  to  this  problem  involves  replacing  (5)  by 

0  =  AQ  +  QA'^-i-n-i-V,  (8) 
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where  17  is  a  constant  positive-definite  matrix.  Rewriting  (8)  as 


0  =  (A  +  AA)Q  +  g(A  +  AAf  +  O  -  (AAQ  +  QAA'^)  +  V,  (9) 

it  follows  that  A  +  A  A  is  stable  so  long  as  A  A  satisfies 

AA<3  +  <3AA^</7,  (10) 

where  Q  is  the  solution  to  (8). 

A  variation  on  equation  (8)  involves  2dlowing  /?  to  be  a  function  of  Q.  Thus  we  consider  the 
modified  Lyapunov  equation 

0  =  AQ  +  QA'^+n{Q)+V,  (11) 

where  /7(*)  satisfies 

AAg  +  gAA'^  <  /7(g),  for  -il  AAeU,  (12) 

and  for  all  nonnegative-definite  g.  It  then  follows  by  rewritmg  (11)  as 

0  =  (A  4-  AA)g  -t-  g(A  -b  AA)***  +  /7(g)  -  (AAg  +  QAA’^)  +  V  (13) 

that  A  +  AA  is  stable.  Furthermore,  letting  satisfy 

0  =  {A+ AA)Qaa  +  Q/^a^{A+ AA)"^ +  V,  .(14) 

and  subtracting. (14)  from  (13)  yields 

0  =  (A  +  AA)(<n  _  Qaa)  +  (g  -  QaaKA  +  AA)’^  +  n{Q)  -  {AAQ  +  QAA’^),  (15) 

which  implies  that 

Qaa<Q,  AAeU.  (16) 

Thuci  tr  QR  provides  a  worst-case  bound  for  the  actual  performance  tr  QaaR- 

Since  the  ordering  induced  by  the  cone  of  nonnegative-definite:  matrices  is  only  a  partial  or¬ 
dering,  it  should  not  be  expected  that  there  exists  an  operator  /?(•)  satisfying  (12)  that  is  a  least 
upper  bound.  Indeed,  there  are  many  alternative  definitions  for  the  bound  /7(*).  To  illustrate  some 
of  these  alternatives,  assume  for  convenience  that  AA  is  of  the  form 

■'  AA  =  <riAi,  jo’ll  <5i, 
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where  <ri  is  an  uncertain  real  scalar  parameter  assumed  only  to  satisfy  the  stated  bounds  zmd  Ai 
is  a  known  matrix  denoting  the  structure  of  the  parametric  uncertainty.  The  bound  !?(•)  utilized 
in  Ref.  24  for  full-state-feedback  design  was  chosen  to  be  the  absolute  value  boimd 

f2(g)=5i|AiQ-l-QA5’l,  (18) 

where  |  •  |  denotes  the  nonnegative-definite  matrix  obtdned  by  replacing  each  eigenv^ue  by  its 
absolute  value.  Since  the  bound  defined  in  (18)  is  not  differentiable  with  respect  to  Q,  it  has 
limited  usefulness  in  fixed-structure  controller  synthesis.  A  more  useful  bound  is  the  quadratic  (in 
Q)  bound 

17(Q)  =  Si[AlA2  +  QAUrQI  (19) 

which  has  been  considered  in  Refs.  25,  26.  In  (19),  Ajj,Ajt  &re  a  factorization  of  Ai  of  the  form 

\ 

Ai  =  AlAr.  a  third  bound  that  has  been  considered  is  the  /m ear  (in  Q)  bound 

n{Q)  =  Si[ctQ  +  a-^AigA?],  (20) 

where  ck  is  an  arbitrary  positive  scalar.  As  discussed  in  Ref.  14,  the  linear  bound  is  closely  related 
to  a  multiplicative  v/hite  noise  model*^.  Extensions  of  LQG  theory  to  include  such  effects  are  given 
in  Refs.  28,  29. 

Within  the  context  of  fixed-structure  controller  synthesis,  the  linear  and  quadratic  bounds  have 
been  merged  with  optimeil  projection  theory  in  Refe.  15  and  16,  respectively.  The  quadratic  bound 
adso  has  the  usefuLproperty  that  it  enforces  em  Hoo  (bounded  real)  constraint.  This  extension  has 
incorporated  within  optimal  projection  theory  in  Ref.  17. 

In  summary,  it  can  be  seen  that  both  the  linear  and  quadratic  bounds  guarantee  robust  stability 
and  performance  with  respect  to  peirameter  uncert^ty  and  leeui  to  generalizations  of  LQG  and 
optimal  projection  theory.  As  discussed  in  Ref.  30,  however,  these  bounds  actually  guarantee 
robustness  with  respect  to  time-varying  parameter  variations,  which  may  lead  to  conservatism 
when  the  parameter  variations  are  known  to  be  constant.  Viewed  in  the  frequency  domain,  such 
bounds  correspond  to  small-gain-type  conditions  which  enforce  robust  stability  with  respect  to 
complex,  frequency-dependent  uncertainty,  which  is  conservative  if  the  uncertain  parameters  are 
known  to  be  real  and  constant.  Such  conservatism  may  have  serious  consequences  in  controlling 
flexible  structures  with  stiffness  uncertainty,  which  is  a  highly  structured,  inherently  real  form  of 
parameter  uncertainty.  Consequently,  we  now  turn  our  attention  to  the  maximum  entropy/optimal 
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projection  approach  to  robust  controller  synthesis  which  seeks  to  overcome  these  difficulties  for  a 
particular  form  of  parametric  uncertainty. 

m.  Maximum  Entropy/ Optimal  Projection  Design  Synthesis 

As  discussed  in  Section  I,  the  ME/OP  approach  was  origiuEdly  developed  in  Refs.  2-6.  In  brief, 
the  basis  of  the  ME/OP  idea  is  to  choose  the  operator  D(Q)  in  the  modified  Lyapunov  equation 
(8)  to  be  of  the  form 

«(<?)= ^21) 

where  the  summation  corresponds  to  an  uncertainty  model  of  the  form  A  +  AA,  where 

r 

■  =  ■  (22) 

t=i 

0*1,..., (Tf  are  uncertain  real  parameters,  amd  5i,...,5r  >  0  are  uncertainty  scalings.  Note  that  in 
(17)  we  set  r  =  1  for  convenience  although  (17)-(20)  could  readily  be  generalized  to  the  case  r  >  1. 

The  unusual  feature  of  (21)  is  that  (as  will  be  seen  shortly)  n{Q)  is  not  a  bound  in  the  sense 
of  (12)  M  are  (18)-(20).  Thus  we  do  not  stipulate  a  precise  uncertainty  range  for  the  uncertain 
parameters  as  in  (17).  Rather,  the  constants  Si,..., Sr  should  only  be  viewed  as  scalings.  Indeed, 
whereas  the  bounds  (18)-(20)  are  valid  for  arbitrary  choices  of  Ai,  the  operator  (21)  will  only  be 
used  (in  this  paper)  under  restrictive,  but  practically  useful,  assumptions.  Specifically,  we  now 
cissume  that  the  nominal  dynamics  matrix  A  is  of  the  form 


A  =  block-diag 


-Vi  "1 

-Wi  -Til 


-Vr  «r 
-Ur  -Tlr 


which  is  representative  of  a  lightly  damped  structure  in  a  modal  basis,  while  the  uncertainty  matrix 
Ai  is  of  the  form 

Ai  =  block-diag(0,...,0,  J  ,0,...,0),  (24) 


where  the  position  of  the  matrix  J  corresponds  to  the  »th  diagonal  block  of  A.  Since  the 

poles  of  A  +  cTiAi  are  of  the  form  -t}  +  j{ui  +  <r,-),  each  term  represents  uncertainty  in 
the  imaginary  part  of  a  pole  location. 

To  further  illustrate  the  structure  of  n{Q)  given  by  (21),  define 

S  =  (25) 
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so  that  (21)  becomes. 

r 

/?(<?)  =  SQ  +  QS  +  '^  SiAiQA:f.  (26) 

«=i 

and  the  modified  Lyapunov  equation  (11)  is  of  the  form 

r 

0  =  (A  +  S)Q  +  Q{A  +  S)^  +  SjAiQ^i  'i'  (2^) 

•=i 


Using  (24)  and  the  fact  that 


0  1 

-1  0 


l3 


-1  0 
0  -1. 


5  can  be  written  as 


S  =  block'diag 


0 

0  -\S^ 


(28) 


It  is  interesting  to  contrast  (26)  with  the  linear  bound  (20)  in  light  of  the  structure  of  S.  To  do 
this,  generalize  (20)  to  the  case  r  >  1  (but  setting  ot  =  1)  which  now  has  the  form 


=  +  (29) 

*=1 


Now  rewrite  (29)  as 

r 

niQ)  =  5Q  +  QS  +  SiAiQAj, 

«=i 

where 


which  yields  a  modified  Lyapunov  equation  of  the  form 


0  =  (A  +  S)Q  +  <5(A  +  S)"^  +  SiAiQAj  +  V, 

*=1 


(30) 


(31) 


which  is  identical  to  (27)  with  S  replaced  by  S. 


Justification  and  insight  into  the  meeming  of  the  modified  Lyapunov  equation  (27)  can  be 
obtsdned  from  several  diverse,  but  interrelated,  points  of  view.  These  are  summarized  as  follows. 


Multiplicative  White  Noise.  As  discussed  in  Section  II,  the  linear  bound  (20)  can  be  viewed 
as  a  consequence  of  a  multiplicative  white  noise  model.  In  fact,ithe  operator  0{Q)  defined  by  (21) 
also  arises  from  a  multiplicative  noise  model  so  long  as  stochastic  integration  is  interpreted  in 
the  sense  of  Stratonovich  rather  than  Ito®^’^*.  The  interesting  feature  of  Stratonovich  stochastic 
integration  (besides  the  fact  that  its  differentials  obey  the  “standard”  rules  of  calculus)  is  that  it 
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arises  naturally  firom  the  limiting  process  in  approximating  the  solutions  to  stochastic  differential 
equations®^.  This  property  weis  used  in  conjunction  with  the  Maximum  Entropy  Principle  of 
Jaynes^^  to  justify  (21)  as  an  imcertainty  model  in  Refs.  2,  5,  whence  the  name  “maximum 
entropy”  controller  synthesis. 

Uniform  Right  Shift  Versus  Variable  Left  Shift.  By  comparing  (27)  to  (31)  it  can  be 
seen  that  they  differ  only  in  the  shift  {S  or  S)  to  the  nominal  dynamics  matrix  A.  Whereas  the 
shift  S  in  (31)  corresponds  to  a  uniform  right  shift  to  the  open-loop  dynamics,  the  shift  S  in  (27) 
represents  a  variable  (mode-by-mode)  left  shift.  In  the  context  of  closed-loop  feedback  control  this 
distinction  has  the  following  effect:  Rather  than  imposing  a  minimal  stability  margin  on  eeu:h  mode 
as  guaranteed  by  the  uniform  right  shift,  the  variable  left  shift  j.  .  :  duces  a  fictitious  augmentation 
of  the  open-loop  damping  to  induce  the  controller  to  “ignore”  uncertain  modes  and  thereby  not 
risk  destabilizing  them. 

Energy  Flow  and  Statistical  Energy  Analysis.  To  further  motivate  the  form  of  /?(<?) 
given  by  (21),  consider  the  differential  equation 


<3(1)  =  nm)) 


(32) 


for  the  case  r  =  1  and  Ai  = 


0 

-1 


,  that  is,  for  the  case  in  which  Q{t)  = 


’Quit)  Qi,it) 

Quit)  Qz2{t) 


IS 


a  2  X  2  matrix.  In  this  case  (32)  is  equivalent  to  the  three  scalar  differential  equations 


gu(*)  =  ^i(<?22(<)-<3uW),  (33) 

Qizil)  =  —hQizit),  (34) 

<332(t)  =  —  Qzzip))-  (35) 


As  t  -♦  00,  note  that  (33)  and  (35)  have  the  effect  of  equilibrating  (equalizing)  <3ii(t)  and  Qzzit) 
since  Qzzit)  >  Quit)  implies  that  <?ii(t)  is  increasing  and  Qzzii)  is  decreasing,  and  vice  versa 
for  Qii(t)  >  Qzzit)-  Although  Qn{l)  and  Qzzit)  may  have  very  different  values  at  t  =  0,  they 
eventually  become  equal  as  t  -»  oo.  Physicdly,  this  equilibration  (which  also  occurs  for  multimodd 
systems  with  r  >  1  and  more  general  choices  of  skew-symmetric  Ai)  reflects  energy  flow  among 
states.  It  is  important  to  point  out  that  energy  flow  in  dynamic  systems  need  not  be  viewed  strictly 
as  a  consequence  of  modeling  uncertainty,  but  rather  as  a  highly  probable  dynamic  event,  much 
like  heat  flow  in  thermodynamics.  This  viewpoint  forms  the  basis  for  StatisticaJ  Energy  Analysis®® 
cmd  energy  flow  models®®"®®.  Returning  to  (33)-(35),  note  that  the  effect  of  n{Q)  when  utilized 
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in  the  context  of  a  differential  equation  of  the  form 

Q(t)  =  AQ(t)  +  +  /2(Q(t))  4-  V  (36) 

is  to  induce  equilibration  of  the  diagonal  elements  of  Q(t)  in  accordance  with  the  size  of  the  scaling 
parameters  Si.  Note  also  that  the  effect  of  (34)  is  to  suppress  the  off-diagonal  element  Qu,  an 
effect  known  as  decorrelation^^,  which  can  be  viewed  as  a  nattiral  consequence  of  uncertainty.  The 
combination  of  these  effects  in  the  limit  of  Izurge  Si  is  to  induce  a  covariance  matrix  of  the  form  jSI, 
where  /d  >  0,  a  state  known  as  equipartition  of  energy^^. 

Positive  Real  Theory.  The  uncertrdnty  AA  defined  by  (22)  is  skew  symmetric,  that  is, 
AA"^  =  —AA.  Thus  AA  is  a  special  case  of  a  positive  real  uncertainty  matrix  F  satisfying^  the 
condition  F+F"^  >0.  Robust  stability  conditions  for  positive  real  uncertainty  have  been  developed 
in  Ref.  39,  where  it  was  shown  that  the  structure  of  these  conditions  is  closely  related  to  the  modified 
Lyapunov  equation  (27).  Important  differences  arise,  however,  due  to  the  fact  that  the  conditions 
given  in  Ref.  39  involve  a  quadratic  term  within  a  matrix  Riccati  equation. 

Structured  Covariance.  A  more  mathematical  and  less  physical  interpretation  of  the  struc¬ 
ture  of  n{Q)  given  by  (21)  can  be  given  in  terms  of  its  effect  on  the  structure  of  the  covariance  Q. 
To  illustrate  this  idea,  which  was  proposed  in  Ref.  40,  let  Q  be  a  covariance  matrix  corresponding 
to  a  nominally  stable  matrix  A  so  that 

AQ  +  QA'^  <  0.  (37) 

If  A  is  perturbed  by  AA,  then  we  wish  to  also  have 

(A  -}-  AA)Q  4-  Q(A  4-  ^A)^  <  0.  (38) 

One  way  to  achieve  (38)  is  to  seek  Q  satisfying  (37)  so  that  the  term  AAQ  -1-  QAA"^  is  sufficiently 
small  compared  to  AQ  4-  QA'^.  For  example,  let  Q  =  ^1  emd  suppose  that  A  4-  A*^  <0.  Then  for 
all  skew-symmetric  AA  it  follows  that  AA  4-  AA"^  =  0  so  that  (38)  holds.  Thus  the  effect  of  the 
perturbation  is  small  due  to  the  structure  (rather  than  the  size)  of  Q.  Note  that  this  approach  is 
potentially  less  conservative  than  usmg  the  bounding  technique  in  which  /?(•)  is  required  to  satisfy 
(12)  for  all  nonnegative-definite  Q,  not  just  for  Q  =  ^I.  This  particular  structure  for  Q  thus 
corresponds  to  energy  equipartition  as  discussed  above. 

Covariance  Averaging.  Suppose  that  in  the  uncertainty  model  (22)  for  AA  the  uncertain 
parameters  a  =  (o’ij..'>®‘r)  are  modeled  as  constant  random  variables  with  a  given  probability 
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distribution.  Then  the  covariance  Q{cr)  given  by 

0  =  (A  +  AA)Q{<t)  +  Q(o-)  (A  +  AA)’’  +  V  (39) 

is  dso  a  random  variable.  The  expected  value  of  Q{(t)  defined  hy  Q  =  IE[(3((t)]  can  thus  be  viewed 
as  the  “average”  covariance  over  the  uncert2dnty  model.  Although  an  exact  cheirzu:terization  of  Q 
is  difficult  to  obtain,  approximations  to  Q  can  be  shown'^^  to  satisfy  equations  similar  to  (27). 

Given  the  modified  Lyapunov  equation  (27),  the  ME/OP  design  equations  can  be  derived  in  a 
streiightforward  manner  following  the  technique  given  in  Ref.  15.  Hence  consider  the  nominal  plant 

i  =  Ax  +  5u  +  Diwi,  X  e  IR”*,  u  6  IR"“,  u;i  G  (40) 

y  =  Cx  +  toj,  ye  IR"*,  (41) 

z  =  E\x,  z  e  IR”*,  (42) 

where  y  is  the  sensor  output,  z  is  the  performance  variable,  and  wi  and  ws  are  (for  convenience 
only)  uncorrelated  white  noise  disturbemces  with  intensities  Vi  >  0  and  Vj  >  0,  respectively.  Also, 


consider  the  H]  cost  functional 

J(A<,,  Bc,Cc)  =  lim  lEfx'^iJix  +  u’'i?2«],  (43) 

where  J?i  =  EiEi  and  Rj  >  0.  The  matrices  Ac,  Be  and  Co  characterize  the  ricth-order  dynamic 
compensator  (ric  <  n) 

Xc  =  AcXc  +  Bey,  Xc  e  IR"‘ ,  (44) 

u  =  -CeXc.  (45) 

Optimization  of  the  performance  functional  (43)  with  the  modified  covariance  model  (27)  applied 
to  the  closed-loop  system  yields  dynamic  compensator  geiins 

Ac  =  r(A.  -QS-  SP)G’^,  (46) 

Be  =  rQC’^Vf\  (47) 

Ce  =  Rj^B'^PG’^,  (48) 

A  A 

where  the  n  x  n  nonnegative-definite  matrices  Q,P,Q,P  satisfy 

r 

0  =  A.Q  -b  Q a7  +  +  +  Q)Ai-  Q^Q  +  (49) 

i=l 

r 

0  =  AjP  +  PAe  +  Ri+Y^  SiAjiP  -b  P)Ai  -  PSP  -b  tXPSPt±,  (50) 

i=l 

0  =  (Ac  -  SP)Q  +  g(A.  -  SPf  +  QBQ  -  txQSQtI,  (51) 

0  =  (A.  -  QSfP  +  P(A,  -  QS)  +  PSP  -  rlPSPrx,  (52) 
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ft-  A  A  A 

rank  Q  =  rank  P  =  rank  QP  =  rie, 

T  =  QP{QP)*,  denotes  the  group  generalized  inverse 


(53) 

(54) 


and  r  has  the  factorization 


r  =  G'^r, 


Here, 


(55) 


=  A  +  S^C^Vf^C,  %  =  DiViD'^.  (56) 

«=:! 

The  matrix  r  defined  in  (54)  is  the  optimal  projection  matrix  which  is  responsible  for  enforcing  the 
reduced-order  constraint  tic  <  n  on  the  compensator. 


The  ME/OP  design  equations  (49)-(54)  can  be  solved  by  usmg  a  homotopy  algorithm*^'^’.  As 
illustrated  by  Figure  1,  tlus  homotopy  algorithm  allows  the  deformation  of  an  LQG  controller  into 
a  full-order  Maximum  Entropy  controller.  The  Maximum  Entropy  controller  is  then  reduced  to 
an  appropriate  order  by  using  an  indirect  controller  reduction  method.  It  is  important  that  this 
initial  reduced-order  controller  approximately  solve  the  ME/OP  design  equations  to  within  a  small 
error,  although  it  is  not  required  to  be  a  stabilizing  controller.  This  can  be  achieved  by  beginning 
with  a  low  authority  LQG  design  and/or  incorporating  a  sufficiently  high  level  of  uncertainty  in 
the  ME  design.  In  practice  a  slight  modification  of  the  balanced  controller  reduction  algorithm 
of  Yousufli  and  Skelton*^  is  currently  used  as  the  indirect  controller  reduction  method.  Once  this 
initial  reduced-order  controller  is  obtained,  the  homotopy  algorithm  is  used  to  deform  this  controller 
into  a  ME/OP  controller.  Then,  if  a  higher  authority  controller  is  desired,  the  final  step  of  the 
algorithm  is  to  increase  the  controller  authority  to  a  desirable  level. 

IV.  A  Benchmark  Problem 


We  now  turn  our  attention  to  the  benchmark  problem  of  Ref.  19.  The  dynamical  system  is 
described  amd  two  associated  design  problems  are  presented. 


Consider  the  two-mass/spring  system  shown  in  Figure  2,  which  is  a  generic  model  of  an  un¬ 
certain  dyneimical  system  with  a  noncolocated  sensor  and  actuator  pair.  A  control  force  acts  on 
body  1,  and  the  position  of  body  2  is  measured  resulting  in  a  noncolocated  control  problem.  This 
system  can  be  represented  in  state-space  form  as 


■ir 

®3 

.®4- 

L 

0  0  10 

0  0  0  1 

-kfmi  k/mi  0  0 

k/mj  -k/m^  0 


■®i' 

•  0  • 

■  0  • 

®2 

®3 

+ 

0 

1/mi 

u-H 

0 

0 

J 

.X4. 

.  0  . 

.l/mj. 

Wl 


(57) 
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*1.  v=  «'  +  « 


(58) 


where 

Xi  =  position  of  body  1 
®3  =  position  of  body  2 
®8  =  velocity  of  body  1 
X4  =  velocity  of  body  2 
u  =  control  input 
wi  =  plant  disturbance 

z  =  performance  variable  (output  to  be  controlled) 
1/'  =  noise-free  measurement 
V  =  sensor  noise 


Design  Problems 

Design  #1.  Design  a  constant  gain  linear  feedback  compensator  of  the  form 

Xe  =  AeZc  +  BeV  (59) 

U  =  CeXe  +  DeV  (60) 

(any  of  these  matrices  may  of  course  be  zero)  with  the  following  properties:  p 

t)  The  closed-loop  system  is  stable  for  mj  =  m3  =  1  and  0.5  <  jfe  <  2.0. 

it)  For  w(t)  =  unit  impulse  at  t  =  0,  the  performance  variable  z  has  a  settling  time  of  about 
15  seconds  for  the  nominal  system  mi  =  m3  =  fc  =  1. 

tit)  The  control  system  can  tolerate  reasonable  measurement  noise  signals  v(t). 

iv)  Achieve  reasonable  performance/stability  robustness  with  reasonable  bandwidth. 

v)  Use  reasonable  controller  effort. 

vi)  Use  reasonable  controller  complexity. 

Design  #2.  Same  as  Design  #1  except  in  place  of  ii)  insert: 
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tV)  w(t)  is  a  sinusoidal  disturbance  of  firequency  0.5  rad/sec  but  whose  amplitude  and  phase, 
although  constant,  are  not  available  to  the  designer.  Achieve  asymptotic  rejection  of  w{t) 
at  the  performance  variable  (i.e.,  minimize  limsupt_,oo  2(t)  with  a  20  second  settling 
time)  for  mi  =  mj  =  1,  0.5  <  A;  <  2.0. 

y.  MB/OP  Control  Design  for  the  Benchmark  Problem 

This  section  considers  design  problems  ■#!  and  ^2  of  the  benchmark  problem  described  in  the 
previous  section.  In  particular,  the  development  of  robust  controllers  using  the  MB/OP  approach 
is  described.  This  approach  was  first  applied  to  the  benchmark  problem  in  Refs.  44  and  45. 


We  begin  by  introducing  some  notation.  Consider  the  plant 

z(t)  =  Ax{t)  +  Bu{t)  +  Diti;i(t), 
z{t)  =  Bii(t), 
y'(t)  =  C'z(t). 


(61) 

(62) 

(63)- 


Then  G(s)  is  said  to  be  the  transfer  matrix  representation  of  (57)-(59)  if 


Likewise  (A,S,C7,i?i,jE7i)  is  said  to  be  the  state  representation  of  (60)  if  (57)-(59)  hold. 


(64) 


Now,  for  a  nominal  value  kaota  of  the  spring  sti&ess  let  the  corresponding  state  representation 
of  the  benchmark  system  shown  in  Figure  2  be  given  by 

i(t)  =  Ao(A;nom)®(t)  +  Bou{t)  +  Di,otwi(t),  (65) 

=  Bi,ox{t)y  (66) 

y'  =  ^'(i)-  (67) 

Also,  let  Go(s)  be  the  transfer  matrix  representation  of  (65)-(67). 

A  precompensation  strategy  was  used  for  control  law  design.  This  precompensation  strategy  is 
illustrated  by  Figures  3  and  4.  As  shown  in  Figure  3  we  simply  embed  the  precompensation  filters 
Cu(s),  ^y'(®)i  C^ti;i(*)  and  C;i(s)  in  the  pleint  a  priori  eind  design  the  ME/OP  controller  £[(a)  for 
this  modified  design  plant.  Then,  as  illustrated  in  Figure  4,  the  precompensation  dynamics  C„(s) 
and  Cyi(s)  are  included  in  the  implemented  compensator  R'(s).  It  is  not  difficult  to  show  that  for 
both  Figures  3  and  4  the  closed-loop  transfer  function  Get{s)  satisfying 


is  identical  in  Figures  3  and  4.  Hence  this  methodology  ensures  that  if  H(s)  is  stabilizing  in  the 
feedback  loop  of  Figure  3,  then  H'(s}  is  stabilizing  in  the  feedback  loop  of  Figure  4.  In  addition, 
(64)  also  ensures  that  the  transfer  function  between  z(s}  and  is  preserved,  thus  ensuring  the 
preservation  of  the  attenuation  from  wi  to  z.  This  precompensation  methodology  was  us^  in  Ref. 
9  to  achieve  controller  roll-off  and  to  force  the  design  plant  to  appear  to  be  rate  feedback.  Its  use 
for  the  benchmark  problem  is  detailed  below. 

To  describe  the  control  design  process  for  each  controller,  assume  that  {A,B,C,Di,Ei)  is  the 
state  space  representation  corresponding  to  (?(s}  in  Figure  3,  such  that 


x(t)  =  Aa:(f)  -f  Bu{t)  +  DiWi{t), 

.(69) 

z(t)  =  i7i®(t), 

(70) 

y\t)  =  Cx{t), 

(71) 

y(t)  =  y’(t)  -t-  it>3(i). 

(72) 

is  the  state  space  representation  of  the  design  plant.  The  synthesis  of  H(s)  in  Figure  3  was  based 
upon  the  solution  of  the  design  equations  (49)-(54). 

The  state  space  basis  of  (69)-(72)  was  chosen  such  that  A  is  block-diagonal  with  a  2  X  2  diagonal 

block  of  the  form  ^  corresponding  to  the  vibrational  mode  of  the  system  with  nominal 

—Wo  u 

natural  frequency  uq.  System  uncertainty  was  assumed  to  be  in  the  frequency  of  this  mode  and 
thus  the  parameter  r  in  eqns.  (49),  (50)  and  (56)  is  given  by  r  =  1.  The  corresponding  uncertainty 
pattern  matrix  Ai  was  given  by 

Ai  =  block-diag(0,.,.,0,  ^  ,0,...,0)  (73) 

where  location  of  the  nonzero  2x2  block  corresponded  to  the  location  of  the  dynsunics  of  the 
vibrational  mode  in  A.  The  design  weights,  and  Vj  were  given  by 

rI  =  F7i,  Vi  =  DiDj,  =  V,  =  p.  (74) 

The  design  pareuneters  are  p,  which  determines  the  control  authority  and  5^^*,  which  weights  Ai 
and  reflects  the  level  of  modal  uncertainty.  Note  that  since  the  sti&ess  k  was  assumed  to  be  in  the 
interval  [0.5  N/m,  2.0  N/m],  the  na-turad  frequency  w  of  the  vibrational  mode  was  in  the  intervad 
[l.O  rad/s,  2.0  rad/s]. 

Three  controllers  are  described  below.  Controllers  1  and  2  were  developed  to  meet  the  objectives 
of  design  problem  #1  while  Controller  3  was  developed  for  problem  if=2.  Controllers  1  and  3  were 
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formulated  as  standard  Hj  disturbance  rejection  problems,  i.e.,  Cu(s}  =  Cy(s)  =  1  in  Figures 
3  and  4.  The  disturbance  weighting  matrix  (s)  was  chosen  in  the  control  design  process  for 
Controller  3  to  reflect  knowledge  of  the  sinusoidal  nature  of  the  disturbance.  For  Controller  2, 
precompensation  W£is  added  to  nullify  the  effects  of  the  rigid  body  mode  in  a  ffequency  band 
approximately  one  deczide  above  and  one  decjide  below  the  frequency  of  the  vibrational  mode. 
Basically,  this  was  an  attempt  to  make  the  problem  “easier”  for  the  LQ6  part  of  the  design.  Cu(s), 
M  will  be  shown,  is  simply  a  second-order  lead-lag  filter.  The  “lag”  poles  were  included  not  only 
to  medce  the  precompensation  realizable  in  state-space,  but  also  to  prevent  the  LQG  segment  of 
the  controller  from  having  to  provide  additional  roll-off.  The  description  of  each  controller  includes 
the  precompensation  dynamics  used  to  developed  the  design  model  and  the  stiffness  ^nom  of  the 
design  model.  The  parameter  Arnom  was  not  chosen  to  be  1  N/m  as  might  be  expected  because  it 
was  experimentally  observed  that  as  6i  increased  the  closed-loop  system  tended  to  become  robust 
with  respect  to  positive  perturbations  in  Arnom  faster  than  with  respect  to  negative  perturbations. 

The  settling  time  for  each  system  was  chosen  to  be  the  time  required  for  the  displacement  of 
mass  2  to  reeich  and  stay  within  the  interval  [-0.1m,  0.1m].  Each  of  the  controllers  satisfied  the 
corresponding  settling  time  objectives  when  coimected  to  the  model  corresponding  to  A;  =  1  N/m. 
Also,  each  of  the  controllers  stabilizes  the  plant  for  k  e  [0.5  N/m,  2.0  N/m],  To  illustrate  the 
effectiveness  of  Maximum  Entropy  design  in  inducing  robustness,  each  of  the  three  controllers  is 
compared  with  the  LQG  design  which  was  used  to  initialize  the  design  process  illustrated  by  Figure 
1.  The  g^  margin  (GM)  and  phase  margin  (PM)  listed  for  each  controller  eire  the  margins  yielded 
by  implementing  each  controller  with  the  corresponding  design  plant.  In  addition,  for  Controllers 
1  and  2  a  simulation  is  provided  which  shows  the  mass  2  displacement  response  when  the  sensor 
measurements  are  corrupted  by  a  noise  process  tV2(t).  In  these  simulations  the  noise  was  chosen  to 
be  white  with  a  uniform  distribution  in  the  interval  [-.01m,  .Olmj. 

Controller  1  (for  Design  Problem  #1) 

The  parameters  for  Controller  1  are  as  follows: 

Cu(3)  =  Cy.(s)  =  C„,(s)  =  C,(s)  =  1 

p  =  .00001,  =  .2 

A^noin  =  N/m  =>  Wo  =  1.0954  rad/s 
order  of  G(s)  =  order  of  jff(s)  =  4  =>■  full-order  design 
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/ 


settling  time  of  the  mass  2  displacement  =  15s  (for  k  =  l) 
peak  response  of  the  m2us  2  displacement  =  .7m  (for  k  =  1) 


.  .  194390(a  +  0.36679)((«  -  0.11735)’  +  0.90996’] 

“  («  +  81.438) («  + 131.04)[(«  +  2.9049)3  + 1.8615*] 

Controller  1:  stable  for  0.45  <  k  <  2.05,  GM=3dB,  PM  =  10 deg 

LQG  Controller:  stable  for  0.59  <  k  <  1.06,  GM  =  IdB,  PM  <  1  deg . 

The  impulse  responses  of  the  mass  2  displeu:ement  (the  output  performance  variable),  the  mass  1 
displacement,  and  the  control  signal  are  shown  respectively  in  Figures  5-7  for  k  =  1.0  N/m,  0.5 
N/m  and  2.0  N/m.  The  impulse  response  of  the  displacement  of  mass  2  for  ib  =  1.0  N/m  with  noise 
corrupted  measurements  is  shown  in  Figure  8.  The  root  locus  with  respect  to  the  controller  gain 
is  shown  in  Figure  9  while  the  Nyquist  plot  of  the  loop  transfer  function  is  shown  in  Figure  11. 

Controller  2  (for  Design  Problem  #2) 


The  parameters  for  Controller  2  are  as  follows: 

..  100[(s  +  .04)’  +  .0693’]  ^ 

(s+ 10)’ +  17.3205’  ’ 

p  =  .0001  a=  .2 


knom  =  0.6  N/m  =^>-  Wo  =  1.0954  rad/s 

order  of  G(s)  =  6,  order  of  ^(s)  =  4  ^  reduced-order  design 

settling  time  of  the  mass  2  displacement  =  5s  (for  k  =  l) 

peak  response  of  the  mass  2  displacement  =  .2m  (for  jb  =  1) 


.  _  2490300(s  +  0.93838)[(s  +  0.30989)’  +  0.40237’][(s  +  0.040000)’  +  0.069282’] 

“  (s  +  54.835)(3  +  18.831)[(s  + 10.000)’  +  17.321’][(s  +  0.014561)’  +  0.031241’] 

Controller  2:  stable  for  .12  <  fc  <  2.03,GM=6dB,  PM  =  33 deg. 

LQG  Controller :  stable  for  A5<k<  1.35,  GM=7dB,  PM=35  deg 
The  impulse  responses  of  the  mass  2  displacement  (the  output  performance  variable),  the  mass  1 
displacement  and  the  control  signal  are  shown  respectively  in  Figures  5-7  for  k  =  1.0  N/m,  0.5 
N/m  and  2.0  N/m.  The  impulse  response  of  the  displacement  of  mass  2  for  k  =  1.0  N/m  with  noi^ 
corrupted  measurements  is  show  in  Figure  8.  The  root  locus  with  respect  to  the  controller  gain  is 
shown  in  Figure  10  while  the  Nyquist  plot  of  the  loop  transfer  function  is  shown  in  Figure  12. 
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Controller  3  (for  Design  Problem  #2) 


The  parameters  for  Controller  3  are  as  follows: 


C'„(s)  =  C„.(s)=C,(«)  =  l, 


(«)  — 


1 

(s  +  0.00050)*  +  0.500000* 


JS^om  =  0.75  N/m  =»•  Wo  =  1.2247  rad/s 


order  of  G(«)  =  order  of  ff(«)  =  6  =►  full-order  design 

settling  time  of  the  mass  2  displacement  =  12s  (for  A;  =  1) 

peak  response  of  the  mass  2  displacement  =  4.4m  (for  k  =  l) 


.  86816(s  +  0.12320)[(a  -  0.21281)^  +  0.96330*][(j  +  0.023916)^  +  0.42427^) 

"  («  +  253.19)(s  +  38.684)((s  +  2.5068)*  +  1.6776*]{(s  +  0.0011218)*  +  0.50138*] 

Controller  3:  stable  for  0.48  <  k  <  2.50,GM=5dB,  PM=22deg 

LQG  Controller :  stable  for  0.43  <  k<  0.78,GM=4dB,  PM  =  22deg. 

The  responses  of  the  mass  2  displacement  (the  output  performance  variable),  the  mass  1  dis¬ 
placement  and  the  control  ngnal  to  a  sinusoidal  disturbance  of  &equen(^  0.5  rad/s  are  shown 
respectively  in  Figures  13-15  for  k  =  1.0  N/m,  0.5  N/m  and  2.0  N/m.  The  root  locus  with  respect 
to  the  controller  gain  is  ^own  in  Figure  16. 

VL  Discussion  of  Results 

Controllers  1  and  2  both  satisfied  the  settling  time  objectives  of  design  problem  #1  but  dif¬ 
fered  significantly  in  their  basic  structure  and  overall  performance.  One  of  the  primary  differences 
between  these  two  controllers  is  best  illustrated  by  the  Nyquist  diagrams  presented  in  Figures  11 
and  12  of  the  corresponding  loop  transfer  functions.  In  these  figures  it  is'  seen  that  both  controllers 
placed  the  loop  transfer  function  in  the  first  quadrant  just  before  the  nominal  frequency  wq.  This 
ensured  stability  when  180**  of  phase  lag  was  added  due  to  the  undamped  vibrational  mode  of 
the  plant.  However,  despite  this  similarity,  the  route  that  the  controllers  took  to  place  the  loop 
transfer  function  in  the  first  quadrant  was  vastly  different.  As  seen  in  Figure  11,  Controller  1 
chose  to  force  the  loop  transfer  function  to  reach  the  first  quadrant  via  the  second  quadrant.  This 
required  substantial  phase  lag  from  the  compensator.  However,  compensator  gain  was  also  needed 
to  achieve  performance.  Hence,  Controller  1  included  a  complex  pair  of  nonminimum  phase  zeros 
to  achieve  both  phase  lag  and  increased  gain.  On  the  other  hand,  the  precompensation  chosen 
for  Controller  2  was  such  that  the  loop  transfer  function  reached  the  first  quadrant  via  the.third 
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and  fourth  quadrants.  The  desired  lecid  and  gain  increase  were  Euicomplished  via  minimum  phase 
compensator  zeros. 

Figures  5  compares  the  impulse  'wsponse  of  mass  2  for  Controllers  1  and  2  while  Figure  6 
compares  the  impulse  ivaponse  of  mass  1  for  the  two  controllers.  It  is  easily  seen  from  these  figures 
that  Controller  2  reduced  the  effects  of  the  impulse  disturbance  on  the  system  much  more  than 
Controller  1.  In  9>liition,  it  is  ceen  in  the  data  listed  for  each  controller  that  Controller  2  heis 
significantly  higher  gain  and  phase  margins  than  Controller  1,  a  feature  that  might  be  desirable 
in  some  applications.  However  Figure  7  reveals  that  the  greater  performance  of  Controller  2  was 
achieved  at  the  expense  of  much  greater  control  authority  and  Figure  8  shows  that,  due  to  its 
higher  bandwidth,  Controller  2  yields  a  closed-loop  system  that  is  much  more  sensitive  to  sensor 
noise.  In  fact,  the  control  authority  required  by  Controller  2  would  likely  require  an  actuator  with 
mass  many  times  the  total  mass  of  the  original  system.  Controllers  1  eind  3  avoided  the  use  of  ein 
impractical  amount  of  actuator  authority  by  the  judicious  use  of  nonminimum  phase  zeros.  We 
conjecture  that  a  low  authority  controller  that  meets  the  performance  objectives  cannot  be  designed 
for  the  benchmark  problem  without  using  nonminimuin  phase  zeros. 

It  is  interesting  to  note  that  the  data  for  Controller  2  shows  that  the  initializmg  LQG  controller 
has  larger  gjun  and  phase  margins  than  the  robust  controller,  but  also  has  less  robustness  with 
respect  to  the  uncertainty  in  the  stiffness  k.  This  provides  an  Ulustration  of  a  control  problem  in 
which  the  gain  and  phase  meurgins  do  not  necessarily  imply  parametric  robustness. 

The  data  for  each  of  the  three  controllers  clearly  shows  chat  the  initializing  LQG  designs  did  not 
satisfy  the  robustness  requirements  xvith  respect  to  the  uncertainty  in  k.  The  efiicacy  of  Maximum 
Entropy  design  in  providing  the  needed  robustness  was  thus  clearly  illustrated  by  the  results  of  this 
paper. 
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Fig.  5.  Mass  2  Displacement  Response  to  an  Impulse  Disturbance  for  Controller  1  (top)  and  Con¬ 
troller  2  (bottom) 
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Fig.  6.  Mass  1  Displacement  Response  to  an  Impulse  Disturbance  for  Controller  1  (top)  Con 
troller  2  (bottom) 
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Fig.  7.  Control  Signal  Response  to  an  Impulse  Disturbance  for  Controller  1  (top)  and  Controller 
2  (bottom) 
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Fig.  9.  Root  Locus  for  Gain  of  Controller  1 


Fig.  13.  Mass  2  Displacement  Response  to  a  .5  rad/s  Sinusoidal  Disturbance  for  Controller  3 


Fig.  14.  Mass  1  DLsplacemeat  Response  to  a  .5  rad/s  SinusoidaJ  Disturbance  for  Controller  3 
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Combined  L2(H^  model  reduction 

WASSIM  M.  HADDADt  and  DENNIS  S.  BERNSTEINJ 

A  model-reduction  problem  is  considered  which  involves  both  (quadratic)  and 
(worst-case  frequency-domain)  aspects;  Specifically,  the  goal  of  the  problem  is  to 
minimize  an  L,  model-reduction  criterion  subject  to  a  prespecified  constraint  on 

the  model-reduction  error.  The  principal  result  is  a  sufficient  condition  for 
characterizing  reduced-order  models  with  bounded  L,  and  approximation 
error.  The  sufficient  condition  involves  a  system  of  modified  Riccati  equations 
coupled  by  an  oblique  projection,  i.e.  idempotent  matrix.  When  the  constraint  is 
absent,  the  sufficient  condition  specializes  to  the  L,  model-reduction  result  given  by 
Hyland  and  Bernstein  (1985). 
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R  £^£,  model-reduction  error-weighting  matrix  in  P' 
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I.  Introduction 

One  of  the  most  fundamental  problems  in  dynamic  systems  theory  is  to 
approximate  a  high-order,  complex  system  with  a  low-order,  relatively  simpler  model. 
The  resulting  reduced-order  model  can  then  be  used  to  facilitate  the  analysis  of 
complex  systems  as  well  as  the  design  and  implementation  of  feedback  controllers  and 
electronic  filters.  The  model-reduction  problem  thus  reflects  the  fundamental  en¬ 
gineering  desire  for  simplicity  of  implementation  and  parsimony  of  hardware. 

In  view  of  the  practical  motivations  for  the  model-reduction  problem,  it  is  not 
surprising  that  significant  effort  has  been  devoted  to  this  problem  in  recent  years. 
Indeed,  there  now  exists  a  well-developed  theoretical  foundation  for  model  reduction 
under  a  variety  of  approximation  criteria.  Expanding  on  the  original  work  of 
Adamjan  et  al.  ( 1971),  progress  was  achieved  by  Kung  and  Lin  ( 1981),  Lin  and  Kung 
(1982),  Glover  (1984),  Latham  and  Anderson  (1985),  Hung  and  Glover  (1986), 
Anderson  (1986),  Ball  and  Ran  (1987)  and:  Parker  and  Anderson  (1987)  for  the 
Hankel-norm  approximation  criterion.  Many  of  the  cited  works  also  present  bounds 
for  the  closely  related  H^,  approximation  error,  although  the  optimal  model- 
reduction  problem  remains  open.  Alternatively,  early  progress  on  the  model- 
reduction  problem  with  a  quadratic  (L2)  criterion  was  achieved  by  Wilson  ( 1970)  and 
further  explored  by  Hyland  and  Bernstein  (1985). 

Although  the  Hankel  norm,  //,,,  and  L,  model-reduction  criteria  represent 
distinct  approximation  objectives,  there  exist  significant  connections.  For  example,  it 
was  shown  by  Wilson- ( 1985),  that  for  systems  which  are  either  single  input  or  single 
output,  the  input  and  output  space  topologies  can  be  redefined  so  that  the  induced 
norm  of  the  Hankel  operator  coincides  with  the  L,  system  norm.  In  addition,  the 
optimization  technique  utilized  by  Wilson  (1970)  was  re-applied  to  the 
Ililbert-Schmidt  Hankel  operator  topology  by  Wilson  (1988).  In  a  recent  work, 
Wilson  ( 1989)  has  shown  that  for  single-input  or  single-output  systems  the  quadratic 
model-reduction  criterion  is  actually  an  induced  norm  of  the  convolution  operator 
itself. 

In  the  present  paper  we  attempt  a  further  unification  of  the  L,  and  //»  model- 
reduction  objectives.  Specifically,  we  consider  an  model-reduction  problem  with  a 
constraint  on  the  approximation  error.  The  underlying  idea  involves  the  suitable 
application  of  a  frequency-domain  inequality  due  to  Willems  (1971),  which  has 
recently  been  applied  to  H^,  control-design  problems  by  Petersen  (l987),‘Khargo- 
n;kar  et  al.  (1937)  and  Bernstein  and  Haddad  (1989).  The  principal  result  of  the 
present  paper  is  a  sufficient  condition  which  characterizes  reduced-order  models 
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satisfying  an  optimized  L,  bound  as  well  as  a  pre-specified  bound.  The  sufficient 
condition  is  a  direct  generalization  of  the  optimal  projection  approach  developed  by 
Hyland  and  Bernstein  ( 1985)  for  the  unconstrained  L,  problem.  While  the  Li-optimal 
reduced-order  model  was  characterized  by  Hyland  and  Bernstein  ( 1985)  by  means  of 
a  coupled  system  of  two  modified  Lyapunov  equations,  the  f/„-constrained  solution 
in  the  present  paper  involves  a  coupled  system  consisting  of  four  modified  Riccati 
equations.  As  in  Hyland  and  Bernstein  (1985),  the  coupling  is  due  to  the  presence  of 
an  oblique  projection  (idempotent  matrix)  that  determines  the  constrained  reduced- 
order  model.  When  the  constraint  is  sufficiently  relaxed,  we  show  that  the 
conditions  given  herein  specialize  directly  to  those  given  by  Hyland  and  Bernstein 
(1985).  Although  our  result  gives  sufficient  conditions  for  approximation,  we  also 
state  hypotheses  under  which  these  conditions  are  also  necessary. 

Although  numerical  algorithms  were  developed  by  Hyland  and  Bernstein  (1985) 
for  the  'pure’  L2  problem,  computational  methods  for  the  //^-constrained  problem 
are  beyond  the  scope  of  the  present  paper.  In  view  of  the  additional  complexity 
engendered  by  the  constraint,  more  sophisticated  algorithms  appear  necessary. 
Hence  computational  methods  will  focus  on  the  homotopic  continuation  algorithm 
developed  by  Richter  (1987)  for  reduced-order  dynamic  compensation. 


2.  Statement  of  the  problem 

In  this  section  we  introduce  the  model-reduction  problem  with  constrained 
norm  of  the  model-reduction  error.  Specifically,  we  constrain  the  transfer  function  of 
the  reduced-order  model  to  lie  within  a  specified  radius  of  the  original  system.  In 
this  paper  we  assume  that  the  full-order  model  is  asymptotically  stable,  i.e.  the  matrix 
A  is  asymptotically  stable. 

H ^-Constrained  L2  model-reduction  problem 

Given  the  nth-order  controllable  and  observable  model 

x[t)  =  Ax[t)  +  BDwit)  (2.1) 

v1r)  =  Cx(f)  ,  (2.2) 

where  t  e  [0, 00),  determine  an  n„th-order  model 

•^«(f)  =  /l«.x„(t)  +  B„Dnit)  (2.3) 

y«(0  =  C„.x„(r)  (2.4) 

which  satisfies  the  following  criteria: 

(i)  A„  is  asymptotically  stable; 

(ii)  the  transfer  function  of  the  reduced-order  model  lies  within  a  radius-y  H  ^ 
neighbourhood  of  the  full-order  model.  i.e. 

\ms)-H„m^^y  (2.5) 

where 

H{s)^EC{sI„-A)-'BD.  H„{s)^EC„[sl„„-A„)-^B„D  (2.6) 

and  y  >  0  is  a  given  constant:  and 
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(iii)  the  L,  model-reduction  criterion 

J{A„,  B„,  CJ  4  lim  E{(j-(r)  -  yJOrRbiO  -  y„(0]}  (2.7) 

is  minimized. 

Note  that  the  full-  and  reduced-order  systems  (2.1)-{2.4)  can  be  written  as  a  single 
augmented  system 

x(t)  =  A.x(t)  +  D»v(r),  r  e  [0,  oo)  (2.8) 

so  that  the  qx  p  transfer  function  from  w(i)  to  Ey(t)  =  £.x(0  is 

H(s)  =  £(s/,-I)-‘D  (2.9) 

and  (2.7)  can  be  written  as 

J{A„,  B„.  C„)  =  lim  E{[£jXr)K£j:</)]}  =  lim  E[.x^(t)£.x(r)]  (2.10) 

t— »  r— X 

Before  continuing  it  is  useful  to  note  that  if  A„  is  asymptotically  stable  then  the 
model-reduction  criterion  (2.7)  is  given  by 

J(A„,B„,CJ  =  tTQR  (2.11) 

where  the  steady-state  covariance 

2^  lim  EC.x(r)x^(t)]  (2.12) 

f  — X 

satisfies  the  augmented  Lyapunov  equation 

0  =  AQ  +  Q^-i-V  .  (2.13) 

Using  (2.1 1)  and  (2.13)  it  can  be  shown  that  the  L2  criterion  (2.7)  is  an  approximation 
measure  involving  the  full-  and  reduced-order  impulse  responses  with  respect  to  an  L, 
norm. 


Proposition  2.1 

The  L,  model-reduction  criterion  (2.11)  can  be  written  as 

*  X 

||£C  exp  {Ai)BD  -  EC„  exp  {A„t)B„D\ip  dt  »2.14  a) 


J(A„,  B„,  CJ  =  IJ 
or,  equivalently 


C„)  =  :^  I  ilH(jco)  -  HjjaMp  dco 


(2.14  b) 


Proof 


It  need  only  be  noted  that  (2.11)  is  equivalent  to 


trj  exp(Jt)i'e.’tp('4''^t)  dtl^  =  tr  J  Eexp(At)DD^ exp{A^t)£^ dt 


(£exp  (.4f)D)(£e.xp  (/lt)D)'''  dt 


=  J  il£e.xp{.4t)Dl!ft/t 
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which  is  equivalent  to  (2.14  a).  Finally,  (2.14  i»)  follows  from  Plancherel’s  Theorem. 

□ 

The  key  step  in  enforcing  (2.5)  is  to  replace  the  algebraic  Lyapunov  equation  (2.13) 
by  an  algebraic  Riccati  equation.  Justification  for  this  technique  is.  provided  by  the 
following  result. 


Lemma  2.1 

Let  (An,  B„,  C„)  be  given  and  assume  there  exists  2  e  R'*"  satisfying 


5eW" 

(2.15) 

and 

0  =  A2  +  2^  +  y--2R2  +  V 

(2.16) 

Then 

(A.D)  is  stabilizable 

(2.17) 

if  and  only  if 

A„  is  asymptotically  stable 

(2.18) 

Furthermore,  in  this  case 

liff(s)-HJs)|l„^7 

(2.19) 

(2.20) 

and 

J(A„,B„,C„)^^(An,B„,C„,2) 

(2.21) 

where 

jf(A„,B„,C„.2)^lrIR 

(2.22) 

Proof 

Using  the  assumed  existence  of  a  non-negative-definite  solution  to  (2.16)  and  the 
stabilizability  condition  (2.17),  it  follows  from  the  dual  of  Lemma  12.2  of  Wonham 
(1979)  that  A  is  asymptotically  stable.  Since  A  is  block  diagonal.  A„  is  also 
asymptotically  stable.  Conversely,  since  A  is  assumed  to  be  asymptotically  stable. 
(2.18)  implies  (2.17).  The  proof  of  (2.19)  follows  from  a  standard  manipulation  of 

(2.16) :  for  details  see  Lemma  I  of  Willems  (1971).  To  prove  (2.20),  subtract  (2.13)  from 

(2.16)  to  obtain 

0  =  A{2-Q)+{2-Q)A^-i-y'-2R2  (2.23) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

2  —  Q=j  exp ( >Tf)[v’“'.^R exp (jT'*"f) t/f > 0  (2.24) 

Finally.  (2.21)  follows  immediately  from  (2.20).  C. 

Lemma  2.1  shows  that  the  constraint  is  automatically  enforced  when  a  non- 
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negative-definite  solution  to  (2.16)  is  known  to  exist.  Furthermore,  the  solution  2 
provides  an  upper  bound  for  the  actual  state  covariance  Q  along  with  a  bound  on  the 
L,  model-reduction  criterion.  Next,  we  present  a  partial  converse  of  Lemma  2. 1  which 
guarantees  the  existence  of  a  non-negative  definite  solution  to  (2.16)  when  (2.19)  is 
satisfied. 

Lemma  2.2 

Let  (/!„,  B„,  C„)  be  given,  suppose  A  is  asymptotically  stable,  and  assume  the  H„ 
■ipproximation  constraint  (2.19)  is  satisfied.  Then  there  exists  a  unique  non-negative- 
definite  solution  2  satisfying  (2.16)  and  such  that  A  y~~2R  is  asyn.ptotically  stable. 
Furthermore,  this  solution  is  minimal. 


Proof 

The  result  is  an  immediate  consequence  of  Theorems  3  and  2,  of  Brockett  (1970; 
pp.  150,  167)  and  the  dual  of  Lemma  12.2  of  Wonham  (1979).  □ 

Finally,  we  show  that  the  quadratic  term  ■/~^2R2  in  (2.16)  also  constrains  the 
Hankel  norm  of  the  approximation  error  Ey  when  2  is  positive-definite.  To  show  this, 
let  PeN"  be  the  observability  Gramian  for  the  augmented  system  {A,D,E)  which 
satisfies 

0  =  ^P-rPA  +  R  (125) 

Furthermore,  note  that  Q  satisfying  (2.13)  is  the  dual  controllability  Gramian. 

Proposition  2.2 

Let  (/!„,  B„,  C„)  be  given  and  assume  there  exists  2eP^  satisfying  (116)  and 
(2.17)  or,  equivalently,  (118).  Then 

(2.26) 


Proof 

Since  2  is  invertible,  (2.16)  implies 

0  =  y'^2- ‘  -5-  y-2- ‘  A  -F y-2- ‘  •  -r  P 


Next,  subtract  (2.25)  from  (2.27)  to  obtain 

0  =  ^{-^2''  -  P)  -5-  (y*  *  -  P)A  +  y*5" ‘  V2~  ‘ 

which,  since  /I  is  asymptotically  stable,  is  equivalent  to 


e,xp(^f)[y-.^"‘  P.2"‘]exp(Jt)  dc^O 


(127) 

(128) 

(129) 


Thus.  (129)  implies  P^y'2~^,  or,  equivalently,  Hence,  2^(P.2) 

^  y.  Finally,  (2.26)  follows  immediately  from  (120).  O 


3.  Auxiliary  minimization  problem  and  necessary  conditions  for  optimality 

As  discussed  in  the  previous  section,  the  replacement  of  (113)  by  (2.16)  enforces 
the  H^  approximation  constraint  between  the  full-  and  reduced-order  systems  and 
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results  in  an  upper  bound  for  the  L,  model-reduction  criterion.  That  is.  if  (2.16)  is 
solvable  then  the  reduced-order  model  IA„,  B„,  C„)  satisfies  the  approximation 
constraint  (2.5)  while  the  actual  L,  model-reduction  criterion  is  guaranteed  to  be  no 
worse  than  the  bound  given  by  B„,  C„,  ^).  Hence,  /(/!„,  B„,  C„,  2)  can  be 
interpreted  as  an  auxiliary  cost  that  leads  to  the  following  mathematical  programming 
problem. 


Auxiliary  minimization  problem 

Determine  (A„,  B„,  C„,  2)  that  minimizes  J(A„,  B„,  C„,  J)  subject  to  (2.15)  and 
(2.16). 

It  follows  from  Lemma  2.1  that  the  satisfaction  of  (2.15)-(2.17)  leads  to  (i)  A„ 
stable;  (ii)  a  bound  on  the  distance  between  the  full-order  and  reduced-order 
systems;  and  (iii)  an  upper  bound  for  the  L,  model-reduction  criterion.  Hence,  it 
remains  to  determine  (A„,B„,C„)  that  minimizes  J^[A„,  B„,  C„,  2)  and  thus 
provides  an  optimized  bound  For  the  actual  L,  criterion  J(A„,B„,C„).  Rigorous 
derivation  of  the  necessary  conditions  for  the  auxiliary  minimization  problem  requires 
additional  technical  assumptions.  Spedfically,  we  restrict  (A„,  B„,  C„,  2)  to.  the  open 
set 

^ 2):2eP^,A  ■}':/~-2R  is  asymptoticilly  stable. 

and  (/!„,  B„,  C„)  is  controllable  and  observable}  (3.1) 


Remark  1 

The  set  y  constitutes  sufficient  conditions  under  which  the  Lagrange  multiplier 
technique  is  applicable  to  the  auxiliary  minimization  problem.  Specifically,  the 
requirement  that  2  be  positive-definite  replaces  (2.15)  by  an  open  set  constraint,  the 
stability  of  -f-  y~-2R  serves  as  a  normality  condition  and  IA„,  B„,  C„)  minimal  is  a 
non-degeneracy  condition. 

The  following  lemma  is  needed  for  the  statement  of  the  main  result. 

Lemma  3.1 

Let  Q,  P  6  M“  and  suppose  rank  QF  =  n„.  Then  there  exist  n„xnC.r  and  n„  x  n^ 
invertible  M.  unique  except  for  a  change  of  basis  in  fr'".  such  that 

QP  =  G^Mr  (3.2) 

rC^  =  /«_  (3.3) 

Furthermore,  the  n  x  n  matrices 

x^G^r  (3.4) 

(3.5) 

are  idempotent  and  have  rank  n„  and  n  —  n„.  respectively.  If.  in  addition 

rank  Q  —  rank  P  =  n„  (3.6) 


then 


Q  =  xQ,  P  =  Pt 


(3.7).  (3.S) 
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Finally,  if  P  s  M"  then  the  inverse 

S^(ln  +  y-^QP)~'  (3.9) 

exists. 

Proof 

Conditions  (3.2)-(3.8)  are  a  direct  consequence  of  Theorem  6.2.5  of  Rao  and 
Mitra  ( 1971).  To  prove  that  the  inverse  in  (3.9)  exists,  note  that  since  the  eigenvalues 
of  QP  coincide  with  the  eigenvalues  of  the  non-negative-definite  matrix  it 

follows  that  QP  has  non-negative  eigenvalues.  Thus,  the  eigenvalues  of  I„  +  y~^QP 
are  all  greater  than  one  so  that  the  above  inverse  exists.  □ 

Finally,  for  convenience  define 

l^C^RC 

Theorem  3.1 

If  (A„,  B„,  C„,  2)e£P  solves  the  auxiliary  minimization  problem  then  there  exist 
Q,  P,  Q,Pe  IN"  such  that 


/l„  =  r(/l-7-^Q2QPS)CT 

(3.10) 

B„=rB 

(3.11) 

C„  =  C(l„  +  y-^QPS)G-^ 

(3.12) 

~Q  +  Q  Qr~ 

(3.13) 

2=  . 

_  FQ  rQr’^_ 

and  such  that  Q,  P,  Q,  P  satisfy 

0  =  AQ  +  QA^  +  y~^Q2Q  +  z^Zxl  (3.14) 

0  =  A'^P  +  PA-y-*S'^PQlQPS  +  xl{l„  +  y--QPS)'^l{I„  +  y--QPS)x^  (3.15) 
0  =  (A-  y-^QtQPS)Q  +  Q{A  -  y-^QlQPS)'^  +  y-<>QS^ PQtQPSQ 

-fZ-Tj.2rI  (3.16) 

0  =  (A+y-^Ql)^P  P(A  +  y-^Ql)+(l„  +  y--QPS)^l(I„  +  y-^QPS) 

-  tI(/„  +  y-'QP5)^2(/„  ■,-y-^QPS)x^  (3.17) 

rank  g  =  rank  P  =  rank  QP  =  (3.18) 

Furthermore,  the  auxiliary  cost  is  given  by 

/{A„,  B„,  C„,  2)  =  ixt(Q  +  y-*QPSQS^PQ)  (3.19) 


Conversely,  if  there  exist  Q,  P,Q,Pe  IN"  satisfying  (3. 14)-(3. 18),  then  (/1„,  B„,  C„,  2) 
given  by  (3.10)-(3.13)  satisfy  (2.15)  and  (2.16)  with  the  auxiliary  cost  (2.22)  given  by 
(3.19). 
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Proof 

See  Appendix  A. 


Remark  2 

Theorem  3.1  presents  necessary  conditions  for  the  auxiliary  minimization  problem 
that  explicitly  synthesize  extremal  reduced-order  models  (A„,  B„,  C„).  As  a  check  of 
these  conditions,  consider  the  extreme  case  n„  =  n.  Then  G  =  F"  ‘  and  thus,  without 
loss  of  generality,  G  =  F  =  t  =  /„  and  =  0.  Furthermore,  (3.14)  implies  that  Q  =  0 
and  (3.15)  implies  that  P  =  0.  Hence  the  ^^-constrained  full-order  model  is  given  (as 
expected)  by  (A,B,C)  regardless  of  >*.  Furthermore,  note  that  J  given  by  (3.13) 
becomes 


£  = 


Q  Q 
Q  Q 


(3.20) 


so  that  the  quadratic  term  y"^J2Pi2in(2.16)  vanishes.  Thus,  (2.16)  reduces  to  (2.13)  so 
that  J  coincides  with  the  controllability  Gramian  Q.  If,  alternatively,  the  reduced- 
order  constraint  is  retained  but  the  transfer  function  approximation  constraint  (2.5)  is 
sufficiently  relaxed,  i.e.  y-*oo,  then  S  =  /„  so  that  the  reduced-order  model 
(3.10)-(3.12)  is  given  by  (/1„,  B„,  C„)  =  (F/1G^  FB,  CC^).  In  this  case,  (3.14)  and 
(3.15)  are  superfluous  and  (3.16)  and  (3.17)  reduce  to  the  optimal  projection  equations 
obtained  by  Hyland  and  Bernstein  (1985)  for  the  unconstrained  L,  problem. 


4.  Sufficient  conditions  for  combined  approximation 

In  this  section  we  combine  Lemma  2.1  with  the  converse  of  Theorem  3.1  to  obtain 
our  main  result  guaranteeing  constrained  approximation  along  with  an  optimized 
L2  model-reduction  bound. 


Theorem  4. 1 

Suppose  there  exist  Q,  P,Q,  Pe  IN"  satisfying  ( 3. 1 4)  -( 3. 1 8)  and  let  ( ,  B„ ,  C„ ,  i) 
be  given  by  (3.10)-(3.13).Then  (4.  D)  is  stabilizable  if  and  only  if  A„  is  a.symptotic:illy 
stable.  In  this  case,  the  reduced-order  transfer  function  H„(s)  satisfies  the  approxi¬ 
mation  constraint 


and  the  L2  approximation  bound 

||//(s)  -  H„(s)|l,  <  [tr  1(Q  +  y-^QPSQS^PQ)y'- 


(4.1) 

(4.2) 


Proof 

The  converse  portion  of  Theorem  3.1  implies  that  £  given  by  (3.13)  satisfies  (2.15) 
and  (2.16)  with  auxiliary  cost  given  by  (3.19).  It  now  follows  from  Lemma  2.1  that  the 
stabilizability  condition  (2.17)  is  equivalent  to  the  asymptotic  stability  of  A„,  the  //„ 
approximation  condition  (2.19)  holds,  and  the  L,  model-reduction  criterion  satisfies 
the  bound  (2.21)  which  is  equivalent  to  (4.2).  □ 

In  applying  Theorem  4.1,  the  principal  issue  concerns  conditions  on  the  problem 
data  under  which  the  coupled  Riccati  equations  (3.14)-(3.17)  possess  non-negative- 
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definite  solutions.  Clearly,  for  y  sufficiently  large,  {3. 14) -(3. 17)  approximate  the  ‘pure’ 
Li  solution  obtained  by  Hyland  and  Bernstein  (1985).  In  practice,  we  would 
numerically  solve  (3.14)-(3.17)  for  successively  smaller  values  of*/  until  solutions  are 
no  longer  obtainable.  The  important  case  of  interest,  however,  involves  small  y  so  that 
accurate  approximation  is  enforce^d.  Thus,  if(4.1)  can  be  satisfied  for  a  given  */  >  0 
by  a  class  of  reduced-order  models,  it  is  of  interest  to  know  whether  one  such 
reduced-order  model  can  be  obtained  by  solving  (3. 14) -(3. 17).  Lemma  2.2  guarantees 
that  (2.16)  possesses  a  solution  for  any  model  satisfying  (4.1).  Thus  our  sufficient 
.conditions  will  also  be  necessary  so  long  as  the  auxiliary  minimization  problem 
possesses  at  least  one  extremal  over  When  this  is  the  case  we  have  the  following 
immediate  result. 

Proposition  4. 1 

Let  •/*  denote  the  infimum  of  ||//(s)  —  H„(s)||,^  over  all  asymptotically  stable 
reduced-order  models  and  suppose  that  the  auxiliary  minimization  problem  has  a 
solution  for  all  y  >  y*.  Then  for  all  y  >  y*  there  exist  Q,  P,  Q,  P  e  IN"  satisfying 
(3.14)-(3.17). 

Remark  3 

As  in  Hyland  and  Bernstein  (1985),  it  can  be  expected  that  (3.14)-(3.17)  possess 
multiple  solutions.  Theorem  4.1  guarantees,  however,  that  the  bounds  (4.1)  and  (4.2) 
are  enforced  for  all  such  extremals  obtained  by  solving  (3. 14) -(3. 1 7). 
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Appendix  A 
Proof  of  Theorem  3.1 

To  optimize  (2.22)  over  the  open  set  -5^  subject  to  the  constraint  (2.1 6),.form  the 
lagrangian 

/.)  ^  tr  {UR  +  [AJ  +  JP  +  y-'£R2  +  VJiP}  (A  1) 
where  the  Lagrange  multipliers  2^0  and  ^  e  R’’ ' "  are  not  both  zero.  We  thus  obtain 

—  =  (A  +  y-URf.3>>  +  .nA+y-UR)  +  U  (A  2) 

Setting  cSi^lcil  =  0  yields 

0  =  {A  +  y-'JRf:^  +  nA  +y'^M)  +  /.R  (A3) 

Since  A  +  y~~2R  is  assumed  to  be  stable.  2  =  0  implies  iP  =  0.  Hence,  it  can  be 
assumed  without  loss  of  generality  that  2  =  1.  Furthermore,  ^  is  non-negative- 
definite. 

Now  partition  hx  h,  d,  into  n  x  n,  n  x  n„,  and  n„  x  n„  sub-blocks  as 


i  = 


Pl2 

P, 
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and  for  notational  convenience  define 


Zi  Z,2 

^21  ^2 


where 


—  PlQl  ■^12  “  Sl2  +  ^1262 

Z2.  ^  PnQi  +  ^22T2.  Z2  ^  P]zQi2  +  PlQz 

Thus,  with  /.  =  I  the  stationarity  conditions  are  given  by 

0^  -  -  ~  ~ 

—  =  (A  +  y~^iiR)^^  +  !^(A+y~-^R)  +  R=Q 
u:z 


gS£ 

oA„ 


=  Z,  =  0 

=  P]2By+PyB„V  =  0 


(A  4) 
(A  5) 
(A  6) 


—  =  2RC„0,  +  2y-- RC„Z],Q^y  -  2/?CQ,,  -  v'-RCZlQ,, 

-y--RCQ,Zi2-7"-/?CZl,Q2  =  0 


(A-7) 


Expanding  (2.16)  and  (A  4)  yields 

0  =  AQ,+Q,A-^  +  y--{Q^C^-QnClmQiC^-QMCl)^  +  BVB^  (A8) 

0  =  AQ^2  +  Ql2Al  +  y-^Q^C^RCQ^,-y-'-Q,,ClRCQ^^-r-Q^C^RC„Q, 

+  'r-Qi2ClRC„Q,  (A  9) 

0  =  A„Qy  +  QyAl-r  'r'iQjyC^-QzCDRlQhC^-QzCD^+B^VBl  (A  10) 
0  =  A  ^  P ,  +  P ,  /I  +  ■/  -  -  R  CZ{  -  y  ■  ^  R  C„  ZT 2  +  ■/  "  -  Z ,  C’'  R  C 

-•/--Z.jCRC  +  C^RC  (All) 

0  =  A’^P^2  +  PnA„  +  y--C^RCZh-y--Z^C^RC„  +  y--Z^,ClRC„ 

-C^RC„  (A  12) 

0  =  AlPy  +  PyA„-y-'-ClRCZh-y--Z,^C^RC„  +  ClRC„  (A  13) 


Now  define  the  «  x  n  matrices 

2 - Q.222'‘e!2.  P^P^- PxzPI ‘ Plz 
Q^QMQVQjzy  P^PxzPl'P^Z 
^^-QizQVPVPJz 

and  the  n„  x  n,  n„  x  n„  and  x  n  matrices 

c^er‘2T2.  w4q,p,.  r^-p,-‘p[. 

The  existence  of  Q  J  ‘  and  PJ  *  follows  from  the  fact  that  (/1„,  B„,  C„)  is  minimal.  See 
Bernstein  and  Haddad  ( 1989)  and  Hyland  and  Bernstein  (1985)  for  details.  Note  that 
X  =  G^r.  Clearly,  Q,  P,  Q  and  P  arc  symmetric  and  non-negative-definite. 
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Next  note  that  with  the  above  definitions.  (A  5)  implies  (3.3)  and  that  (3.2)  holds. 
Hence,  r  =  G^f  is  idempotent,  i.e.  t*  =  t.  Sylvester’s  inequality  yields  (3.18).  Note  also 
that  (3.7)  and  (3.8)  hold. 

The  components  of  J  and  can  be  written  in  terms  of  Q,  P,  Q,  P,  G  and  f  as 


Qt=Q  +  Q,  Pi  =  P  +  P 

(A  14) 

Qxi  =  QP\  Px2  =  -pg^ 

(A  15) 

Q2  =  PQP\  P2  =  GPG^ 

Next  note  that  by  using  (A  14)-(A  16),  (A  7)  becomes 

(A  16) 

Cj  =  CUn  +  7--{Q  +  Q)P]G^ 

where 

S^I„„  +  y-'-rQPG^ 

To  prove  that  S  is  invertible  use  (3.7)  and  (3.4)  and  note  that 

/„„  + 7""  rQPG^  =  rdr^PG^ 

=/„„+7'-(rdr)(GPGT) 

Since  TQV'^  and  GPG^  are  non-negative-definite,  their  product  has  non-negative 
eigenvalues.  Thus  each  eigenvalue  of  l„„-i-'r~PQ.PG^  is  real  and  is  greater  than 
unity.  Hence  S  is  invertible.  Now  note  that  by  using  ( 3.3)  and  ( 3.4)  it  can  be  shown  that 

G^S-‘r  =  Sr 

The  expressions  (3.11),  (3.12)  and  (3.13)  follow  from  (A  6),  (A  7),  (3.9)  and  the 
definition  of  J  by  using  the  above  identities.  Next,  computing  either  F  ( A  9)  -  (A  10) 
or  G(A12)-f(A13)  yields  (3.10).  Substituting  this  expression  for  A„  into 
(A  8)-(A  13)  it  follows 'that  (A  10)  =  FfA  9)  and  (A  13)  =  G(A  12).  Thus.  (A  10)  and 
(A  13)  are  superfluous  and  can  be  omitted.  Next,  using  (A  8)  -f  G^FfA  9)G  — (A  9)G 
-C(A9)G]'^  and  G^F(A  9)G -(A  9)G  -  [(A  9)G]^  yields  (3.14)  and  (3.16). 
Using  (A  !!)  +  F^G(A  12)F-(A  12)F-C(A  12)F]T  and  F^C(A  12)F-1A  12)F 
-  [(A  12)F]T  yields  (3.15)  and  (3.17). 

Finally,  to  prove  the  converse  we  use  (3.10)-(3.18)  to  obtain  (2.16)  and 
(A  4)-(A  7).  Let  A„,  B„,  C„,  G.  F,  t,  Q,  P.  Q,  P,  J  be  as  in  the  statement  of  Theorem 
3.1  and  define  2, ,  Q,,,  22.  Fj .  Ft2.  ^2  ’<>7 (A  14)-(  A  16).  Using  (3.3), (3.1 1)  andj3.12) 
it  is  easy  to  verify  (A  6)  and  (A  7).  Finally,  substitute  the  definitions  of  Q,  P,  0,  P,  G.  F 
and  T  into  (3.14)-(3.17)  along  with  (3.3),  (3.4),  (3.7)  and  (3.8)  to  obtain  (2.16)  and 
(A  4).  Finally,  note  that 


r"] 


which  shows  that  J  ^  0. 
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Abstract:  An  estimator  design  problem  is  considered  which 
involves  both  L,  (least  squares)  and  (worst-case 
rrequency-domain)  aspects.  Specincally.  the  goal  of  the  prob¬ 
lem  IS  to  minimize  an  L^  state-estimation  error  cntenon 
subject  to  a  prespecified  constraint  on  the  state-estimation 
error.  The  estimation-error  constraint  is  embedded  within 
the  optimization  process  by  replacing  the  covariance  Lyapunov 
equation  by  a  -Rtccati  equation  whore  solution  leads  to  an 
upper  bound  on  the  Ly  state-estimation  error.  The  pnncipal 
result  IS  a  sufficient  condition -for  characterizing  fl.xed-order 
(i.e.,  full-  and  reduced-order)  estimators  with  bounded  Lj  and 
estimation  error.  The  sufficient  condition  involves  a  system 
of  modified  Riccati  equations  coupled  by  an  oblique  projec¬ 
tion.  I.e..  idempoteni  matrix.  When  the  constraint  is  ab¬ 
sent.  the  sufficient  condition  specializes  to  the  L^  state-estima¬ 
tion  result  given  in  [2]. 

Keywords:  Kalman  filter:  Hy.  norm;  reduced-order  state 
estimation:  optimal  projection  equations;  Hankcl  norm. 


1.  Introduction 

One  of  the  fundamental  problems  in  dynamic 
systems  theory  is  the  observation  of  state  varia¬ 
bles.  Although  an  e.\tensive  theoretical  foundation 
has  been  developed  for  the  quadratic  (least 
squares)  error  criterion,  state  estimation  with  a 
worst-case  frequency-domain  design  objective  has 
apparently  not  been  considered.  In  the  present 
paper  we  thus  extend  the  least  squares  formula- 

*  Supported  in  part  by  the  Air  Force  Office  of  Scientific 
Research  under  contract  F‘t9620-S6-C-0002. 


tion  to  include  a  frequency-domain  bound  on  the 
state-estimation  error.  The  underlying  idea  in¬ 
volves  the  application  of  state-space  techniques 
which  have  recently  been  developed  for  Hy.  con¬ 
trol  design  in  [1.4-6].  The  results  of  the  present 
paper  are  thus  complementary  to  the  results  ob¬ 
tained  in  [Ij. 

The  principal  result  of  the  present  paper  is  a 
sufficient  condition  which  yields  full-  and  re¬ 
duced-order  estimators  satisfying  an  optimized  L, 
error  bound  as  well  as  a  prespecified  Hy.  error 
bound.  In  the  full-order  case,  the  //,^-constrained 
estimator  involves  a  modified  Riccati  equation 
which  specializes  to  the  standard  steady-state  Kalr 
man  filter  when  the  Hy.  constraint  is  absent.  In 
the  reduced-order  case  the  //^-constrained  result 
leads  to  a  direct  generalization  of  the  optimal 
projection  approach  developed  in  (2)  for  the  un¬ 
constrained  L,  state-estimation  problem.  While 
the  L2-optimal  reduced-order  state  estimator  was 
characterized  in  (2)  by  means  of  a  coupled  system 
of  one  modified  Riccati  equation  and  two  mod¬ 
ified  Lyapunov  equations,  the  //.^-constrained 
solution  involves  a  coupled  system  consisting  of 
three  modified  Riccati  equations  and  one  mod¬ 
ified  Lyapunov  equation.  As  in  [2].  the  coupling  is 
due  to  the  presence  of  an  oblique  projection 
(idempotent  matri.x)  with  additional  coupling  now 
arising  from  the  Hy.  constraint.  When  the  Hy. 
constraint  is  sufficiently  rela.xed.  these  conditions 
again  specialize  directly  to  those  given  in  [2]. 

MVe  note  that  the  development  in  the  present 
paper  is  limited  to  the  case  in  which  the  plant  is 
asymptotically  stable.  These  results  can  also  be 
extended  to  the  unstable  plant  case,  although  with 
additional  complexity.  This  case  will  thus  be 
treated  in  a  future  paper. 

The  contents  of  the  paper  are  as  follows.  After 
collecting  notation  in  Section  2.  the  statement  of 
the  //.^-Constrained  State-Estimation  Problem  is 
given  in  Section  3.  The  principal  result  of  this 
section  (Lemma  3.1)  .show.s  that  if  the  algebraic 
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Lyapunov  equation  for  the  covariance  is  replaced 
by  a  modified  Riccati  equation  possessing  a  non- 
negative-definite  solution,  then  the 
estimation-error  constraint  is  enforced  and  the  L, 
state-estimation  error  criterion  is  bounded  above 
by  an  auxiliary  cost  function.  The  problem  of 
determining  a  reduced-order  estimator  which 
minimizes  this  upper  bound  subject  to  the  Riccati 
equation  constraint  is  considered  in- Section  4  as 
the  Auxiliary  Minimization  Problem.  Necessary 
conditions  for  the  Auxiliary  Minimization  Prob¬ 
lem  (Theorem  4.1)  are  given  in  the  form  of  a 
coupled  system  of  modified  algebraic  Riccati 
equations.  To  develop  connections  with  standard 
Kalman  filter  theory  the  full-order  estimator  result 
is  also  given.  In  Section  5  the  necessary  conditions 
of  Theorem  4.1  are  combined  with  Lemma  3.1  to 
yield  sufficient  conditions  for  bounded  and 
L;  estimation  error.  Although  our  result  gives 
sufficient  conditions  for  estimation  error,  we 
also  state  hypotheses  under  which  these  conditions 
are  also  necessary  (Proposition  5.1). 


L:  qy.n  matri.x. 

A^.  C/.  matrices. 


oil 

B,C 

3  = 

■  D,  ■ 

B,D,  ' 

A.. 


E=[EL  -EC,]. 


R:  E^E.  estimation  error  weighting  in  P''. 
»v(-):  /^-dimensional  standard  white  noise  pro¬ 
cess. 

y,:  intensity  of  D-.w{.)\  K,  = 

DiDj  e  k\  y.  =  Z),  Z)?'  S  P'. 

K,,;  cross  intensity  of  Z),w(-),  D,w{-)\  1^,2  = 


lJrl  -i7rc, 
-cJrl  cJrc, 

B,y.Bj  ■ 


y:  positive  constant. 


2.  Notation  and  definitions 

R.  R',  E:  real  numbers,  rXs  real 

matrices.  R'^*.  expected  value. 

Z„  0^.  0,:  rXr  identity  matri.x,  trans¬ 

pose.  rXs  zero  matrix.  0,x,. 

tr:  trace. 

an,„(Z):  largest  singular  value  of  matrix  Z. 

AmaxCZ):  largest  eigenvalue  of  matrix  Z  with  a 
real  spectrum. 

II  Z||  pi  [tr  ZZ^l’''"  (Frobenius  matrix  norm). 

||Z/(j)||„:  sup„s„a^J/ZO’«)l. 

S',  fy'.  P':  rXr  symmetric,  nonnegative-defi¬ 
nite.  positive-definite  matrices. 

Z,  <  Z2,  Z|  <  Z2:  Z2  —  Z,  s  Zi  —  Z|  e 
P'.  Z„  ZjSS'. 

n.  /.  n,.  p.  q,  r,  it  positive  integers;  n  -J-  n,; 
n,<n. 

y-  >t"  ^e'  ''r*  n-dimensional 

vectors. 


A.C:  nXn.  lx n  matrices. 

Z),.  D,.  E:  nXp.  I Xp.  rXq  matrices. 


3,  Statement  of  the  problem 

In  this  section  we  introduce  the  reduced-order 
state-estimation  problem  with  a  constraint  on  the 
H.J.  norm  of  the  state-estimation  error.  Specifi¬ 
cally,  the  transfer  function  between  disturbances 
and  error  states  is  constrained  to  have  //„  norm 
less  than  y.  In  this  paper  it  is  assumed  that  the 
plant  is  asymptotically  stable,  i.e..  the  eigenvalues 
of  A  are  in  the  open  left  half  plane. 

Z/^-Constrained  State-Estimation  Problem.  Given 


the  n-th-order  observed  system 

.x(r)  =  /I.Y(f) -f  Z),»v{').  (3.1) 

>(r)  =  C.x(r)  •rZ);w(r).  (3.2) 

where  i  e  [0,  cc).  determine  an  /i..-th-order  state 
estimator 

=  B,y{t).  (3.3) 

yAi)  =  C,.x,{i).  (3.4) 


where  which  satisfies  the  following  design 

criteria: 
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(i)  is  asymptotically  Stable; 

(ii)  the  r  X  p  transfer  function 

H{s)^E{sI;,-Ay'b  (3.5) 

from  disturbances  »v{r)  to  error  states  E[Lx{t)  — 
y,(r)]  =  Ex{t)  satisfies  the  constraint 

(3.6) 

where  y  >  0  is  a  given  constant:  and 

(iii)  the  Li  state-estimation  error  criterion 

4^,.  B,,  C) 

=  E([Z.x(r)- v,(r)]’^f?[L.>:(r)  -jv{f)]} 

(3.7) 

is  minimized. 

It  is  useful  to  note  that  the  augmented  system 
(3.1)-(3.4)  can  be  written  as 

.?(f)  =/l.x(r) -f  Div(r),  rs[0.  oo),  (3.8) 

and  that  (3.7)  is  equivalent  to 

y(^,.  B,.Cj  =  ^limE([£x(r)f[£.x(0]} 

=  limE[.x‘f(t)£jc(r)l.  (3.9) 

/  — cc 

Furthermore,  if  A^  is  asymptotically  stable  for  a 
given  estimator  {A^,  C,)  then  the  £,  state- 

estimation  error  criterion  is  given  by 

J{A,,  B,,  CJ  =  tr  QR,  (3.10) 

where  the  steady-s.tate  covariance  defined  by 

lim  E[.x(r).x'^(r)|  (3.11) 

f— ■» 

satisfies  the  /I  x  «  Lyapunov  equation 

0  =  AQ-i-Q^-i- y.  (3.12) 

Using  (3.10)  and  (3.12)  we  now  show  that  the 
criterion  (3.7)  is  an  error  measure  involving  the 
impulse  response  of  (3.8)  with  respect  to  an  Lj 
norm. 

Proposition  3.1.  1/  A^  is  asymptotically  stable  then 
the  £2  state-estimation  criterion  (3.7)  can  be  written 
as 

J{A,.  B,.  C,)  =  /■“ll  £e"'£l|/.  dr.  (3.13) 

-'0 


Proof.  It  need  only  be  noted  that  (3.10)  is  equiv¬ 
alent  to 

IT  f  dtR 

■'0 

=  tr  [“(£  e^''^)(£  dr. 

■'0 

which  is  equivalent  to  (3.13).  □ 

The  key  step  in  enforcing  (3.6)  is  to  replace  the 
algebraic  Lyapunov  equation  (3.12)  by  an  alge¬ 
braic  Riccati  equation.  Justification  for  this  tech¬ 
nique  is  provided  by  the  following  result. 

Lemma  3.1.  Let  (A,.  B^,  C,)  be  given  and  assume 


there  exists  2.  R'”'"  satisfying 

(3.14) 

and 

0-=A2+2^  +  y~-2R2-i-V.  (3.15) 

Then 

{A,  b)  is stabilizable  (3.16) 

if  and  only  if 

A^  is  asymptotically  stable.  (3.17) 

Furthermore,  in  this  case 

I|//(^)l|..c^V.  (3.1S) 

Q<2.  (3.19) 

and 

J{A,,  B,,  Q)  B,.  C,.  2).  (3.20) 

where 

Jf{A,.  B,.C,,2)^tT2R.  (3.21) 


Proof.  Theorem  3.6  of  [9]  and  (3.16)  imply  that 
I  A.  [y~~2R2-i-  P]*'-)  is  also  stabilizable.  Using 
Lemma  12.2  of  (9j  and  the  assumed  existence  of  a 
nennegative-definite  solution  to  (3.15),  it  follows 
that  A  is  asymptotically  stable.  Since  A  is  lower 
block  triangular,  A  asymptotically  stable  implies 
A,  is  asymptotically  stable.  Conversely,  since  A  is 
assumed  to  be  asymptotically  stable.  (3.17)  implies 
A  is  asymptotically  stable  and  thus  (3.16)  holds. 
The  proof  of  (3.18)  follows  from  a  standard 
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manipulation  of  (3.15);  for  details  see  Lemma  1  of 
[8).  To  prove  (3.19)  subtract  (3.12)  from  (3.15)  to 
obtain 

0  =  A{2-Q)-i-{£-Q)A^-i-'r-2R2.  (3.22) 

which,  since  A  is  asymptotically  stable,  is  equiv¬ 
alent  to 

2-Q  =  ri'''[y--2R2]e-^’  dr  2: 0.  (3.23) 

Jq 

Finally,  (3.20)  follows  immediately  from  (3.19). 
□ 

Lemma  3.1  shows  that  the  Hy.  constraint  is 
automatically  enforced  when  a  nonnegative-defi- 
nite  solution  to  (3.15)  can  be  shown  to  exist. 
Furthermore,  the  solution  2  provides  an  upper 
bound  for  the  steady-state  covariance  Q  along 
with  a  bound  on  the  L,  state-estimation  error 
criterion.  Next,  we  present  a  partial  converse  of 
Lemma  3.1  which  guarantees  the  e,xistence  of  a 
nonnegative-definite  solution  to  (3.15)  when  (3.18) 
is  satisfied. 

Lemma  3.2.  Let  (/I,,  5,,  C,)  be  given,  suppose  A, 
is  asymptotically  stable,  and  assume  the  Hy.  state- 
estimation  error  constraint  (3.18)  is  satisfied.  Then 
there  exists  a  unique  nonnegative-definite  solution  2 
satisfying  (3.15)  and  such  that  AA-'(~~2R  is 
asymptotically  stable.  Furthermore.  2  is  the 
minimal  solution  to  (3.15). 

Proof.  The  result  is  an  immediate  consequence  of 
Theorems  3  and  2  of  [3].  pp.  150  and  167,  along 
with  the  dual  of  Lemma  12.2  of  (9].  □ 

Finally,  we  show  that  the  quadratic  term 
y~-2R2  in  (3.15)  also  constrains  the  Hankel  norm 
of  the  estimation  error  £[Lj:(r)  — y,(r)]  when  2 
is  positive  definite.  To  show  this  let  P  s  be  the 
observability  Gramian  for  the  augmented  system 
(A.  b.  E)  which  satisfies 

0  =  rFP-i-PA~R.  (3.24) 

Proposition  3.2.  Let  (A,,  Q)  be  given  and 
assume  there  e.xtsts  2^P”  satisfying  (3.15)  and 
(3.16)  or.  equivalently.  (3.17).  Then 

^'inl[PQ)^Y-  (3.25) 


Proof.  Since  2  is  invertible.  (3.15)  implies 

0  =  y-/F£~ '  +  y-5" '/f 4-  y-2- 'y2-^-i-R.  (3.26) 

Next,  subtract  (3.24)  from  (3.26)  to  obtain 

0  =  A^{-r2-' -P)-i-{y-2-' -  P)A 

~y-2-^V2-\  (3.27) 

which,  since  A  is  asymptotically  stable,  is 
equivalent  to 

y-2-'  -  P  =  /■“e^''[Y-5“‘F£-‘]e-^'' dr  >  0. 

■'0 

(3.28) 

Thus  (3.28)  implies  P<y-2-',  or  equivalently. 
2'^-P2'^-  <  '{-In.  Hence, 

y"  ^  =  X„«*(F'^-5P'''-) 


4.  The  auxiliary  minimization  problem  and  neces¬ 
sary  conditions  for  optimalitv’ 

As  discussed  in  the  previous  section,  the  re¬ 
placement  of  (3.12)  by  (3.15)  enforces  the  Hy. 
state-estimation  error  constraint  and  results  in  an 
upper  bound  for  the  state-estimation  error 
criterion.  That  is.  given  an  estimator  (A^.  Q) 
satisfying  the  //„  estimation  constraint,  the  actual 
Z.2  state-estimation  error  criterion  is  guaranteed  to 
be  no  worse  than  the  bound  ,/lA,,  B^.  C,.  2)  if 
(3.15)  is  solvable.  Hence.  ^{A^.  B^.  Q,.  2)  can 
be  interpreted  as  an  auxiliary  cost  which  leads  to 
the  following  optimization  problem.  * 

Auxiliary  Minimization  Problem.  Determine  (4,. 
B^.  Q.  2)  which  minimizes  B^.  C,.  2) 

subject  to  (3.14)  and  (3.15). 

It  follows  from  Lemma  3.1  that  the  satisfaction 
of  (3.14)-(3.16)  leads  to  (1)  A^  stable;  .(2)  Hy. 
estimation  error  bound  •{:  and  (3)  an  upper  bound 
(3.21)  for  the  L^  state-estimation  error  criterion. 
Hence  it  remains  to  determine  (.4^.  B^.  Q)  which 
minimizes  ,/(.•!,,.  B^.  C,,  2)  and  thus  provides  an 
optimized  bound  for  the  actual  L^  criterion 
A  A,.  B,..  C,.).  Rigorous  derivation  of  the  neces¬ 
sary  conditions  for  the  Auxiliary  Minimization 
Problem  requires  additional  technical  assump- 
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lions.  Specifically,  we  restrict  {A,.  5,.  C,.  2.)  to 
the  open  set 

5^=  {(/!,.  5,.  Q.  5):  2^P\ 

A  -j-  '(~~2R  is  asymptotically  stable, 
and  {Af.  C,)  is  controllable 
and  observable.} 

Remark  4.1.  The  set  constitutes  sufficient  con¬ 
ditions  under  which  the  Lagrange  multiplier  tech¬ 
nique  is  applicable  to  the  Auxiliary  Minimization 
Problem.  Specifically,  the  requirement  that  2  be 
positive  definite  replaces  (3.14)  by  an  open  set 
constraint,  the  stability  of  A-i-y~-2R  serves  as  a 
normality  condition,  and  (/!,.  B,.  Q)  minimal  is 
a  nondegeneracy  condition. 

The  following  lemma  is  needed  for  the  state¬ 
ment  of  the  main  result. 

Lemma  4.1.  Lei  Q,  and  suppose  rank  QP 

=  rt,.  Then  there  exist  n^Xn  <7,  F  and  n^Xn^ 
invertible  M.  unique  except  for  a  change  of  basis  in 
R"'.  such  that 

QP  =  G'^Mr,  (4.1) 

*  (4.2) 

Furthermore,  the  nXn  matrices 

r^G^r,  (4.3) 

(4.4) 

are  idempoient  and  have  rank  n^  and  n  —  n^,  re¬ 
spectively.  If.  in  addition. 

rank  Q  =  rank  P  =  n,.  (4.5) 


(4.6).  (4.7) 


Q  =  rQ.  P  =  Pt. 

Finally,  if  PBl^”  then  the  inverse 


Proof.  Conditions  (4.1)-(4.7)  are  a  direct  conse¬ 
quence  of  Theorem  6.2.5  of  [7).  To  prove  that  the 
inverse  in  (4.8)  exists,  note  that  since  the  eigenval¬ 
ues  of  QP  coincide  with  the  eigenvalues  of  the 


(4.13) 


(4.14) 


nonnegative-definite  matrix  P^'^'QP'^-,  it  follows 
that  QP  has  nonnegative  eigenvalues.  Thus,  the 
eigenvalues  of  I„  -i-  y~~QP  are  all  greater  than  one 
so  that  the  above  inverse  e.xists.  O 

Finally,  for  arbitrary  Q  S  K"’'"  define 
e^  =  eC'^-i- K,,.  I  =  L^RL.  (4.9) 

Theorem  4.1.  If  {A^.  B^.  C,.  2)&SP  solves  the 
Auxiliary  Minimisation  Problem  then  there  exist  Q. 
P.  Q.  such  that 

A,  =  r(A-  Q,V{  'C  -  y-^OIQPS ) C\  (4.10) 
=  (4.11) 

C,  =  L{l„-^y--QPS)G'^.  (4.12) 

^Jq*q  erl 

FQ  FQF^ 

and  such  that  Q.  P.  Q.  P  satisfy 
Q  =  AQ^QA^--rV^-Ty--Q2Q 

-  'QZ  'i  Qu^Z  'QZ^I  •  (4.14) 

0  =  A'^P-i-PA-  y-'S'^PQSQPS 

( /„  -5-  y-*CPS)’’z(  /„  -i-  y--QPS)r^ . 

(4.15) 

0  =  (^  - y-'QIQPS)Q ^Q(A- y-'OZQPSf 
^y-^QS^PQZQPSQ 

^QaVT^QZ-'^QaVz'QZ-l-  (4.16) 

Q  =  {A-OJ^f:'C^y--QZfp 

^P[A-QJ^^C^y--Q^) 

Hfn^'r'QPS)'m„^y--QPS) 

-ir  y--QPSfs{  I„  4-  y--QPS)r^  . 

(4.17) 

rank  Q  =  rank  P  =  rank  QP  =  n,.  (4.18) 

Furthermore,  the  au.xiliary  cost  is  given  by 
Jf{A,.  B,.  C,.  2) 

=  tr  LjRL{Q-ir  y-'^QPSQS^PQ).  (4.19) 

Conversely,  if  there  e.xist  Q.  P.  Q.  P  €  satisfy¬ 
ing  {4.14)-.{4.18).  then  (..I,.  B,.  C^.  2)  given  by 
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{4.10)-(4.13)  satisfies  (3.14)  and  (3.15)  with  the 
auxiliary  cost  (3.21)  given  by  (4.19). 

Proof.  See  Appendix  A.  □ 

Remark  4.2.  Theorem  4.1  presents  necessary  con¬ 
ditions  for  the  Auxiliary  Minimization  Problem 
which  explicitly  synthesize  extremal  full-  and  re¬ 
duced-order  estimators  {A,.  B,,  Q).  If  the 
estimation  constraint  is  sufficiently  rela.xed.  i.e.. 
y  -*  00.  then  S  =  /„.  In  this  case  equations  (4.16) 
and  (4.17)  become  decoupled  from  (4.15)  and  thus 

(4.15)  becomes  superfluous.  Furthermore.  (4.14). 

(4.16)  and  (4.17)  specialize  to  the  optimal  projec¬ 
tion  equations  obtained  in  [2]. 

As  discussed  in  (2],  in  the  full-order  (Kalman 
filter)  case  n,  =  /i.  <7  =  F"'  and  thus  <7  =  F  =  t  = 
I„  and  =  0  without  loss  of  generality.  To  de¬ 
velop  further  connections  with  the  standard  Kal¬ 


man  filter  theory  assume 

Pi,  =  0.  (4.20) 

In  this  case  (4.15)  implies  that  P  =  0  so  that  the 
gain  expressions  (4,10)-(4.12)  become 

=  (4.21) 

=  (4.22) 

C=£..  (4.23) 

while  equations  (4.14)-(4.16)  and  auxiliar>'  cost 
(4.19)  specialize  to 

0  =  AQ^QA^-lr 

^■r'QljRLQ  -  QC^Vf^CQ.  (4.24) 

^(  A,.  B,.  C,.  2)  =  tr  L^RLQ.  (4.25) 


Remark  43.  Note  that  the  necessary  conditions 
for  the  full-order  problem  involve  one  modified 
Riccati  equation.  This  equation  is  similar  to  the 
observer  Riccati  equation  with  the  additional 
quadratic  term  y~-Ql7RLQ.  Finally,  note  that 
when  the  estimation  constraint  is  sufficiently 
rela.xed.  i.e..  y  —  x.  (4.24)  reduces  to  the  standard 
observer  Riccati  equation  of  steady-state  Kalman 
filter  theory. 

5.  Sufficient  conditions  for  combined  L^/H-k 
estimation 

In  this  section  we  combine  Lemma  3.1  with  the 
converse  of  Theorem  4.1  to  obtain  out  main  result 


guaranteeing  constrained  state-estimation  er¬ 
ror  and  an  optimized  state-estimation  error 
bound. 

Theorem  5.1.  Suppose  there  exist  Q.  P.Q.  W" 

satisfying  (4.14)-(4.18)  and  let  (A,.  B,.  C,.  be 
given  by  (4.10)-(4.13).  Then  {A.  D)  is  stabilizable 
if  and  only  if  A^  is  asymptotically  stable.  In  this 
'case,  the  transfer  function  H{s)  defined  by  (3.5) 
satisfies  the  state-estimation  error  constraint 

li  His)  l\^£v.  (5.1) 

and  the  L,  state-estimation  error  criterion  (3.7) 
satisfies  the  bound 

JiA,.  B,.  C) 

^  tr  L^RL  ( Q  -  y-'QPSQS^PQ ) .  (5.2) 

Proof.  The  converse  portion  of  Theorem  4.1  im¬ 
plies  that  £  given  by  (4.13)  satisfies  (3.14)  and 
(3.15).  It  now  follows  from  Lemma  3.1  that  the 
stabilizability  condition  (3.16)  is  equivalent  to  the 
asymptotic  stability  of  A,,  the  state-estima¬ 
tion  error  constraint  (3.1S)  holds,  and  the  !.> 
state-estimation  error  criterion  (3.7)  satisfies  the 
bound  (3.20)  which,  by  (4.19).  b  equivalent  to 
(5.2).  O 

In  applying  Theorem  5.1  the  principal  issue 
concerns  conditions  on  the  problem  data  under 
which  the  coupled  Riccati  equations  (4.14)-(4.17) 
possess  nonnegative-definite  solutions.  Cleariy.  for 
y  sufficiently  large.  (4.14)-(4.17)  jppro.ximate  the 
pure  least  squares  problem  considered  in  (2j.  The 
important  case  of  interest,  howev’cr.  involves  small 
y  so  that  significant  estimation  is  enforced. 
Thus,  if  (5.1)  can  be  satisfied  for  a  given  y  >  0.  it 
is  of  interest  to  know  whether  one  such  fi.xed-order 
estimator  can  be  obtained  by  solving  (4.i4)-{4.17). 
Lemma  3.2  guarantees  that  (3.15)  possesses  a  solu¬ 
tion  for  any  fi.xcd-order  estimator  satisfying  (5.1). 
Thus  our  suffiaent  conditions  will  also  be  neces¬ 
sary  so  long  as  the  .Auxiliary  Minimization  Prob¬ 
lem  possesses  at  least  one  extremal  over  SP.  When 
this  is  the  case  we  have  the  following  result. 

Proposition  5.1.  Let  y’  denote  the  infimum  of 
,J  //(X)  I  ^  overall  asymptotically  stable  fixed-order 
estimators  and  suppose  that  the  .tiCiihar}  Minimiza¬ 
tion  Pndilem  has  an  e.xtremal  for  all  v  >  y".  Then 
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for  all  y>y*  there  exist  Q,  P,  Q,  P  satisfy¬ 
ing  (4.14)-(4.17). 


Appendix  A:  Proof  of  Theorem  4.1 

To  optimize  (3.21)  over  the  open  set  6^  subject 
to  the  constraint  (3.15),  form  the  Lagrangian 

^{A,,  Q,  3»,  X) 

^tT{\^R  +  [A£l+£A^  +  y-'^^R2+  v]^}, 

(A.l) 

where  the  Lagrange  multipliers  XkO  and 
are  not  both  zero.  We  thus  obtain 


^  =  {A  +  y~^2R)^3^+3i>{A+y~^2R)-hXR. 

‘  (A.2) 

Setting  =  0  yields 

0  =  (i  +  y~-£Ry^-h^{A  +  y~^£lR)  +  XR. 

(A.3) 

Since  A+y~^2R  is  assumed  to  be  stable,  X  =  0 
implies  ^=0.  Hence,  it  can  be  assumed  without 
loss  of  generality  that  X  =  1.  Furthermore.  is 
lionnegative  definite. 

Now  partition  hxh,  Q,  P  into  nXn,  nXn,., 
and  n,.Xn,.  subblocks  as 


Q\  Q\z 
Ql.  Qi 


9^ 


Pi  PX2 
Pjz  Pz 


and  for  notational  convenience  define 
92.= 


Z\  Z,2 

Zt 


where 

'^x^PxQx^PmQv.- 


'Z.2^^PJzQx^PzQ).z, 


^12  ~  ^i2i2  +  PxzQz^ 

Zz^PxzQxz  +  PzQz- 


Thus,  with  X  =  1  the  stationarity  conditions  are 
given  by 

~  =  {A+y--2R)  2^+9{A+y--2R)-i- R 
=  0,  (A.4) 


aA, 

dsp 

^se 


=  Zi  =  0. 

=  ZiiC"^  +  Pj^Vx.  +  =  0, 


(A.5) 

(A.6) 


.^^=lRC,Q.  +  ly-'-RC,ZlQx^ 

-lRLQ^^-y--RLZfQx^ 

-y-'^RLQ^Zx2-y--RLZlxQz 


=  0. 


(A.7) 


Expanding  (3.15)  and  (A.4)  yields 
0  =  /ie, +  Q,/l'r+  K, 

■^y--{QxL^ -  QxzC7)r(QxL^ -  QxzCjf . 

(A.8) 

0  =  AQ,.  +  Q,.Al  +  QxC^Bf  + 

■Vy-^QxL^RLQx^  -  y--Qx.CjRLQx. 
~y--QxL^RC,Q.  +  y-'QxzCjRC,Q.,  (A.9) 
0  =  -4,22  +  +  BjCQxz  +  QJzC^BI  +  B.V.Bf 

^y-‘[QlzL^  -  QzCJ)r[qI,l^  -  QzCj)\ 

{k.m 

0  =  A^Px  +  ?,/!  +  C^B^Pf^  +  PxzB.C 
■Vy-'LfRLZj  +  y--ZxlJRL 

-y~-LfRC,Zf.  -  y--Zx.CjRL  +  CRL, 

(A.ll) 


‘4^Pi2  +  Pxz^.  +  C^BfP. 

^y--L7RLZjx-'r-ZxL^RC, 

+  y--Zx2CjRC,  -  LfRC,, 

(A.12) 

AjP.  +  P2A,-  y--C7PLZ2^, 

-y--Z2x^'^PC,+  CfRC,. 

(A.13) 

P^Px  -  PxzPf'Plz- 


Now  define  the  n  X  «  matrices 

Q  ~  Qx  ~  QxzQz 'QJz^  p~ 

Q^QxzQVQJz-  P  =  PxzPf'PJz- 

T=  “2i2Q2  'P’  '^12* 

and  the  n,.  Xn,  n^X  n,..  and  n,.Xn  matrices 

G^QVQIz-  f^=QzPz-  r=-Pf^Pf.. 

The  existence  of  2? '  Pz'  follows  from  the 
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fact  that  B,..  Q.)  is  minimal.  See  [1.2)  for 
details.  Note  that  t  =  G^F.  Clearly.  Q.  P,  Q,  and 
P  are  symmetric  and  nonnegative  definite. 

Next  note  that  with  the  above  definitions.  (A.5) 
implies  (4.2)  and  that  (4.1)  holds.  Hence  t=  G^F 
is  idempotent.  i.e..  t*  =  t.  Sylvester's  inequality 
yields  (4.18).  Note  also  that  (4.6)  and  (4.7)  hold. 

The  components  of  2  and  ^  can  be  written  in 
terms  of  Q.  P.  Q.  P.  G.  and  F  as 

2,  =  2  + 2.  P,  =  P  +  P.  (A.14) 

Q,,  =  QF'^.  P.p.  =  -  PC  ^  (A.15) 

Q.  =  FQF'^.  P.  =  GPG'^.  (A.16) 

Next  note  that  by  using  (A.14)-(A.16),  (A.7)  be¬ 
comes  * 

Cj=L[l„  +  y~-{Q  +  0P]G'^. 

where 

S  =  I„_  +  y~-FQPG'^. 

To  prove  that  S  is  invertible  use  (4.6)  and  (4.3) 
and  note  that 

/„_  +  y-^-FQPG^  =  +  y--FQr'^PG'^ 

=  I„^  +  y--{FQF^){GPG^)- 

Since  FQF^  and  GPG^  are  nonnegative  definite, 
their  product  has  nonnegative  eigenvalues.  Thus 
each  eigenvalue  of  +  y''FQPG^  is  real  and  is 
greater  than  unity.  Hence  5  is  invertible.  Now 
note  that  by  using  (4.2)  and  (4.3)  it  can  be  shown 
that 

CTS"'  =5C'^. 

The  e.xpressions  (4.11),  (4.12)  and  (4.13)  follow 
from  (A.6),  (A.7).  (4.8)  and  the  definition  of  2  by 
using  the  above  identities.  Next,  computing  either 
r(A.9)  -  (A.IO)  or  C(A.12)  +  (A.13)  yields  (4.10). 
Substituting  this  expression  for  A^.  into  (A.8)  - 
(A.13)  it  follows  that  (A.10)=  F{A.9)  and  (A.13) 
=  C(A.12).  Thus.  (A.IO)  and  (A.13)  are  superflu¬ 
ous  and  can  be  omitted.  Next,  using 

(A.8)  -H  G'^F{A.9)G-  (A.9)C  -  [(A.9)C7]’^ 

and 

G'^ F{A.9)G  -  {A.9)G  -  ((A.9)C]’^ 


yields  (4.14)  and  (4.16).  Using 

(A.ll)  +  r'^G(A.12)r-  (A.\2)F-[(A.l2)Ff 

and 


F^G(A.l2)F~{A.l2yF-  ((A.12)r]'^ 


yields  (4.15)  and  (4.17). 

Finally,  to  prove  the  converse  we  use  (4.10)- 
(4.18)  to  obtain  (3.15)  and  (A.4)-(A.7).  Let  A^., 
Q..  G-  r.  T.  Q.  P.  Q.  P.  2  be  as  in  the 
statement  of  Theorem  4.1  and  define  Q,,  Q,,. 

P,.  P,,.  P;  by  (A.14)-(A.16).  Using  (4.4).  (4.11) 
and  (4.12)  it  is  easy  to  verify  (A.6)  and  (A.7). 
Finally,  substitute  the  definitions  of  Q,  P.  Q-  P, 
G.  r  and  t  into  (4.14)-(4.17)  along  with  (4.2), 
(4.3),  (4.6)  and  (4.7)  to  obtain  (3.15)  and  (A.4). 
Finally,  note  that 


2  = 


Q 

4“ 

/I 

.r. 

e[/, 


which  shows  that  2'^Q.  □ 
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LQG  Control  with  an  Ha,  Performance  Bound: 
A  Riccati  Equation  Approach 

DENNIS  S.  BERNSTEIN,  member,  ieee,  and  WASSIM  M.  HADDAD,  member,  ieee 


Abstract— An  LQG  control-design  problem  involving  a  constraint  on 
//•  disturbance  attenuation  is  considered.  The  //.  performance  con¬ 
straint  is  embedded  within  the  optimization  process  hy  replacing  the 
covariance  Lyapunov  equation  by  a  Riccati  equation  whose  solution  leads 
to  an  upper  bound  on  h  performance.  In  contrast  to  the  pair  of  separated 
Riccati  equations  of  standard  LQG  theory,  the  //.-constrained  gains  are 
given  by  a  coupled  system  of  three  modified  Riccati  equations.  The 
coupling  illustrates  the  breakdowii  of  the  separation  principle  for  the  //.- 
constrained  problem.  Both  full-  and  reduced-order  design  problems  are 
considered  with  an  //.  attenuation  constraint  involving  both  state  and 
control  variables.  An  algorithm  is  developed  for  the  full-order  design 
problem  and  illustrative  numerical  results  are  given. 


I.  Introduction 

The  fundamental  differences  between  Wiener-Hopf -Kalman 
(WHK)  control  design  (for  example,  LQG  theory  [1])  and  //» 
control  theory  [2]-[4]  can  be  traced  to  the  modeling  and  treatment 
of  uncertain  exogenous  disturbances.  As  explained  by  Zames  in 
the  classic  paper  (2],  LQG  design  is  based  upon  a  stochastic  noise 
disturbance  model  possessing  a  fixed  covariance  (power  spectral 
density),  while  theory  is  predicated  on  a  deterministic 
disturbance  model  consisting  of  bounded  power  (square-integra- 
ble)  signals.  Since  LQG  design  utilizes  a  quadratic  cost  criterion, 
it  follows  from  Plancherel’s  theorem  that  WHK  theory  strives  to 
minimize  the  Lz  norm  of  the  closed-loop  frequency  response, 
while  Ha,  theory  seeks  to  minimize  the  wor.'»-case  attenuation. 
For  systems  with  poorly  modeled  disturbances  which  may  possess 
significant  power  within  arbitrarily  small  bandwidths,  is 
clearly  appropriate,  while  for  systems  with  well-known  distur¬ 
bance  power  spectral  densities,  WHK  design  may  be  less 
conservative. 

In  addition  to  the  fact  that  //„  design  embodies  many  classical 
design  objectives  [S),  it  also  presents  a  natural  tool  for  modeling 
plant  uncertainty  in  terms  of  normed  //„  plant  neighborhoods.  In 
contrast,  the  Hz  topology  has  been  shown  in  (6]  to  be  loo  weak  for 
a  practical  robustness  theory,  while  the  Ha,  norm  is  not  only 
suitable  for  robust  stabilization  but  is  also  conveniently  submulti- 
plicative.  Within  the  WHK  state-space  theory,  however,  the 
appropriate  robustness  model  appears  not  to  be  a  nonparametric 
normed  plant  neighborhood  as  in  Ha,  theory,  but  rather  a 
parametric  uncertainty  model.  The  principal  technique  for  bound¬ 
ing  the  effects  of  real  parameters  within  state-space  models  is 
Lyapunov  function  theory  (see,  e.g.,  [7]-[16]  and  the  references 
therein).  Such  structured  uncertainties  are  difficult  to  capture 
nonconservatively  within  Ha,  theory  except  with  specialized 
refinements  [17]. 
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In  spite  of  the  fundamental  differences  betv/een  WHK  design 
and  Ha,  theory,  a  significant  connection  was  discovered  in  [18]. 
Specifically,  Petersen  observed  that  a  modified  algebraic  Riccati 
equation  developed  for  parameter-robust  full-state-feedback  con¬ 
trol  can  be  reinterpreted  to  yield  controllers  satisfying  Ha, 
disturbance  attenuation  bounds.  This  relationship  was  Either 
explored  in  [19]  where  it  was  shown  that  the  //„-optimal  static 
fuli-state-feedback  controller  is  also  optimal  over  the  class  of 
dynamic  full-state-feedback  controllers.  The  results  of  [18]-[20] 
thus  solve  the  standard  problem  considered  in  [3]  and  [4]  for  the 
full-state-feedback  case. 

The  extension  of  these  results  to  the  standard  problem  for 
dynamic  output-feedback  compensation,  however,  was  not  given 
in  [18]-[20].  Within  the  realm  of  quadratic  robust  stabilization, 
the  dynamic  output-feedback  problem  was  addressed  in  [7].  The 
results  of  [7]  involve  a  pair  of  decoupled  modified  Riccati 
equations  along  with  an  auxiliary  inequality.  Using  different 
techniques,  a  more  complete  solution  was  obtained  in  [13]  and 
[14]  involving  a  coupled  system  of  three  modified  Riccati 
equations  for  fiill-order  dynamic  compensation  and  a  coupled 
system  of  four  modified  Riccati  and  Lyapunov  equations  in  the 
fixed-order  (i.e.,  reduced-order)  case  as  in  [21].  The  results  of 
[13]  and  [14]  thus  raise  the  following  question:  What  is  the 
relevance  of  this  system  of  coupled  design  equations  to  the 
problem  of  //„  disturbance  attenuation  via  fixed-order  compensa¬ 
tion? 

To  begin  to  address  this  question,  the  goal  of  the  present  paper 
is  to  develop  a  design  methodology  for  fixed-order,  i.e.,  full-  and 
reduced-order,  Lz  optimal  control  which  includes  as  a  design 
constraint  a  bound  on  Ha,  disturbance  attenuation.  There  are  three 
principal  motivations  for  developing  such  a  theory.  First,  the 
results  of  [18]-[20]  present  fuil-state-feedback  controllers  whose 
form  is  directly  analogous  to  the  standard  LQR  solution. 
However,  no  Lz  interpretation  was  provided  in  [18]-[20]  to 
explain  this  similarity.  The  present  paper  thus  provides  an  Lz 
interpretation  within  the  context  of  an  Ha,  design  constraint.  A 
novel  feature  of  this  mathematical  formulation  is  the  dual 
interpretation  of  the  disturbances.  That  is,  within  the  context  of  Lz 
optimality  the  disturbances  are  interpreted  as  white  noise  signals 
while,  simultaneously,  for  the  purpose  of  //„  attenuation  the  very 
same  disturbance  signals  have  the  alternative  interpretation  of 
deterministic  Lz  functions.  This  dual  interpretation  is  unique  to 
the  present  paper  since  stochastic  modeling  plays  no  role  in  [18]- 
[20].  We  also  note  recent  results  obtained  in  [22]  which  essentially 
show  that  the  Hz  plant  topology  can  be  induced  by  imposing  Lz 
and  La,  topologies  on  the  disturbance  and  output  spaces,  respec¬ 
tively.  For  further  investigation  into  the  relationships  between  Lz 
and  Ha,  control,  see  [22a]. 

The  second  motivation  for  our  approach  is- the  simultaneous 
treatment  of  both  Lz  and  Ha,  performance  criteria  which 
quantitatively  demonstrates  design  tradeoffs.  Specifically,  in 
order  to  enforce  the  Ha,  constraint  we  derive  an  upper  bound  for 
the  Lz  criterion.  Minimization  of  this  upper  bound  shows  that  the 
enforcement  of  an  Ha,  disturbance  attenuation  constraint  leads 
directly  to  an  increase  in  the  Lz  performance  criterion. 

The  third  motivation  for  our  approach  is  to  provide  a 
characterization  of  fixed-order  dynamic  output-feedback  control- 
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lers  yielding  specified  disturbance  attenuation.  Existing  optima 
//„  design  methods  tend  to  yield  high-order  controllers.  Intui¬ 
tively,  solving  the  fixed-order  design  equations  for  progressively 
smaller  //«  disturbance  attenuation  constraints  should,  in  the 
limit,  yield  an  //oo-optimal  controller  over  the  class  of  fixed-order 
stabilizing  controllers.  Although  our  main  result  gives  sufficient 
conditions,  we  also  state  hypotheses  under  which  these  conditions 
are  also  necessary  (Proposition  4.  *).  It  should  also  be  noted  that 
the  inherent  coupling  among  the  modified  Riccati  equations  shows 
that  the  classical  separation  principle  of  LCJG  theory  is  not  valid 
for  the  //o,-constrained  full-  and  reduced-order  design  problems. 

In  the  full-order  case  involving  equalized  Li  and  /f.  perform¬ 
ance  weights,  we  also  show  that  the  /fa,-constrained  gains  are 
given  by  two  rather  than  three  equations  (Section  V).  These  two 
equations  are  precisely  those  given  in  [26]  for  the  pure  Ha, 
problem  without  an  interpretation.  Since  the  results  of  [26]  are 
necessary  as  well  as  sufficient,  these  connections  show  Aat  our 
sufficient  conditions  (at  least  in  this  special  case)  are  also 
necessary.  The  authors  are  indebted  to  ftof.  J.  C.  Doyle  for 
pointing  out  these  relationships  and  to  D.  Mustafa  for  providing  a 
preprint  of  [45]  which  further  clarifies  these  connections. 

Besides  establishing  connections  with  robust  stabilizabiliQi  in 
state-space  systems,  an  immediate  benefit  of  the  modified  Riccati 
equation  characterization  of  /fa-constrained  controllers  is  the 
opportunity  to  develop  novel  computational  algorithms  for  con¬ 
troller  synthesis.  To  ^is  end  a  continuation  algorithm  has  been 
develop^  for  solving  the  coupled  system  of  three  modified 
Riccati  equations.  In  a  numerical  study  (see  Section  VIII)  we  have 
demonstrated  convergence  of  the  algorithm  and  reasonable 
computational  efficiency.  Homotopy  methods  were  suggested  for 
the  coupled  Riccati  equations  because  of  their  demonstrated 
effectiveness  in  related  problems  which  also  involve  coupled 
modified  Riccati  equations  [23]-[25].  Since  Hm  control  problems 
are  solvable  by  established  numerical  methods  [4],  it  should  be 
stressed  that  the  objective  of  these  numerical  studies  is  not  to  make 
direct  comparisons  with  existing  //«  synthesis  algorithms,  but 
rather  to  demonstrate  solvability  of  the  coupled  modified  Riccati 
equations. 

The  contents  of  the  paper  are  as  follows.  After  presenting 
notation  at  the  end  of  this  section,  the  statement  of  the  Ha,- 
constrained  LQG  control  problem  is  given  in  Section  II.  The 
principal  result  of  Section  II  (Lemma  2.1)  shows  that  if  the 
algebraic  Lyapunov  equation  for  the  closed-loop  covariance  is 
replaced  by  a  modified  Riccati  equation  possessing  a  nonnegative- 
definite  solution,  then  the  clos^-loop  system  is  asymptotically 
stable,  the  Ha,  disturbance  attentuation  constraint  is  satisfied,  and 
the  Li  performance  is  bounded  above  by  an  auxiliary  cost 
function.  The  problem  of  determining  compensator  gains  which 
minimize  this  upper  bound  subject  to  the  Riccati  ^nation 
constraint  is  considered  in  Section  III  as  the  auxiliary  minimiza¬ 
tion  problem.  Necessary  conditions  for  the  auxiliary  minimization 
problem  (Theorem  3. 1)  are  given  in  the  form  of  a  coupled  system 
of  tliree  modified  Riccati  equations.  In  Section  IV  the  necessary 
conditions  of  Theorem  3 . 1  are  combined  with  Lemma  2. 1  to  yield 
sufficient  conditions  for  closed-loop  stability,  Ha,  disturbance 
attenuation,  and  bounded  Li  performance.  In  Section  V  we  derive 
alternative  forms  of  the  design  equations  and  specialize  the  results 
to  the  simpler  case  in  which  the  LQG  weights  are  equal  to  the  Ha, 
weights  To  achieve  further  design  flexibility,  the  reduced-order 
control-design  problem  is  considered  in  Section  VI.  A  simplified 
qualitative  analysis  of  the  full-order  design  equations  is  given  in 
Section  VII  to  highlight  important  features  with  regard  to 
existence  and  multiplicity  of  solutions.  Finally,  a  numerical 
algorithm  is  presented  in  Section  VIII  along  with  illustrative 
numerical  results.  A  series  of  designs  is  obtained  to  illustrate 
tradeoffs  between  the  Li  and  Ha,  aspects  and  the  conservatism  of 
the  Li  performance  bound.  Although  in  the  present  paper  the 
numerical  results  are  limited  to  the  case  of  full-order  dynamic 
compensation,  reduced-order  designs  have  been  obtained  in  [27] 
using  Theorem  6. 1 . 


Notation 


Note:  All  matrices  have  real  entries. 

K,  1  Real  numbers,  r  x  s  real  matri¬ 

ces,  expected  value 

4,  (  y,  Orxs,  0,  r  X  r  identity  matrix,  transpose, 

r  X  s  zero  matrix,  Orxr 

tr,  p(  )  Trace,  spectral  radius 

S'",  M',  !?'■  r  X  r  symmetric,  nonnegative- 

definite,  positive-definite  matrices 

Zi^Zi,  Zi<Zi  Zi-Zx  e  33',  Zi  ~  Zx^  !?', 

Zx,Zi  € 

n,  m,  I,  Oc,  p,  Q,qa,',n  Positive  integers;  n  -b  /ic(«c  ^  n) 
X,  u,  y,  Xc,  X  n,  m,  /,  n^,  ri-dimensional  vectors 

[i] 


A,B,  C 

Ac,  Be,  Cc 
A 

wi‘) 


A»  A 

Vx,  Vi 


D 

9 


n  X  n,  n  X  m,  I  X  n  matrices 
UcX  OcOeX  I,  mx  He  matrices 

r  A  BCel 

iBcC  Ac] 

p-dimensional  standard  white 
noise 

n  xp,l  X  p matrices; =  0 


EuEi 

£ 

Ri,  Ri 
R 


qxn,qxm  matrices;  £['£2  =  0 

[Ex  EiCc] 

E\Ex,  ElEi,  Ri  €  (P-" 


9/1  x/i^ 
ClRiCc_ 


=£^£ 


Ele,,  Eia, 
£. 

Rxm  ,  Rza, 

Ra> 

2,  2 
P,  y 


qa,  y-  n,  qa,  X  m  matrices; 
£[.£2„=0 
[Exa,  Eia,Cc] 

El^Exa,,  El^Ela, 


O/IX/Ip 

C^RiaCc^ 


=SL£. 


br;'b^,  c^v-'c 

Nonnegative  constant,  positive 
constant 


n.  Statement  of  the  Problem 

In  this  section  we  introduce  the  L(2G  dynamic  output-feedback 
control  problem  with  constrained  Ha,  disturbance  attenuation 
between  the  plant  and  sensor  disnirbances  and  the  state  and 
control  variables.  Without  the  Li  performance  criterion,  the 
problem  considered  here  essentially  corresponds  to  the  standard 
problem  of  [3]  and  [4].  For  simplicity  we  restrict  our  attention  to 
controllers  of  order  Og  =  n  only,  i.e.,  controllers  whose  order  is 
equal  to  the  dimension  of  the  plant.  This  constraint  is  removed  in 
Section  VI  where  controllers  of  reduced  order  are  considered. 
Hence,  throughout  Sections  II-V  the  controller  dimension  Oc  and 
closed-loop  plant  dimension  n  i,  n  +  Oc  should  be  interpreted  as 
n  and  2n,  respectively.  Controllers  of  order  greater  than  n  are 
generally  of  less  interest  in  practice  and  thus  are  not  considered  in 
this  paper. 
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Hc-Constrained  LQG  Control  Problem:  Given  the  nth-order 
stabilizable  and  detectable  plant 

xlt)=Ax{t)+Bu(t)+D\w(t),  (2.1) 

y{t)=Cx{t)+DiHt)  (2.2) 

{ 

determine  an  nth-order  dynamic  compensator 

ic(t)=AcXc(t)+Bcylt),  (2.3) 

u{t)  =  CcXclt)  (2.4) 

which  satisfies  the  following  design  critena; 

i)  the  closed-loop  system  (2.  l)-(2.4)  is  asymptotically  stable, 
i.e.,  A  is  asymptotically  stable; 

ii)  the  ^0.  X  p  closed-loop  transfer  function 

His)  k  eM-A)-'D  (2.5) 

from  w{t)  to  EiaXiO  +  Eia,u{()  satisfies  the  constraint 

||/f(5)IU^7  .  (2.6) 

where  7  >  0  is  a  given  constant;  and 

iii)  the  performance  functional 

J(A,,  Be,  Cc)  i  lim  ^lx^t)RiX(t)  +  u^(t)R2u(t)](2.1) 
is  minimized. 

Note  that  the  closed-loop  system  (2.1)-(2.4)  can  be  written  as 
X(.t)=AJ(U)+GwU)  (2.8) 

and  that  (2.7)  becomes 

J(Ae,  Be,  Cc)=  lim  m^U))HSxm 

=  lim  l(;f^(r)7?;f(/)].  (2.9) 

f-*OD 

Remark  2.1:  Since  (A,  B,  C)  is  assumed  to  be  stabilizable  and 
detectable  the  set  of  nth-order  stabilizing  compensators  is  non¬ 
empty. 

Remark  2.2:  It  is  easy  to  show  that  the  performance  functional 
(2.7)  is  equivalent  to  the  more  familiar  expression  involving  an 
averaged  integral,  i.e., 

y(^c,  Be,  Q)=Iim  ]  [  [jr^(5)BiA,(s) 

/-a)  t  I  Jo 

+  k^(j)/?2u(s)]  dyj  . 

Remark  2.3:  For  convenience  we  assume  DiDl  =  0,  which 
effectively  implies  that  the  plant  disturbance  and  sensor  noise  are 
uncorrelated. 

Remark  2.4:  One  may  also  consider  a  general  Lz  optimization 
problem  of  the  form  min  ||r  -  UQV^z,  where  Q  is  a 
parameterization  of  stabilizing  controllers.  In  diis  case,  without  a 
constraint  on  the  MacMillan  degree  of  Q,  it  may  be  possible  to 
satisfy  (2.6)  with  smaller  values  of  7. 

Note  that  the  problem  statement  involves  both  Lz  and  Ha 
performance  weights.  In  particular,  the  matrices  R\  and  Rz  are  the 
Lz  weights  for  the  state  and  control  variables.  By  introducing  Lz- 
weighted  variables 

z{t)=EiX{t),  v(t)=Ezu{t) 

the  cost  (2.7)  can  be  written  as 

J(Ae,  Be,  C,)=lim  2[z^t)zU)  +  v^i)vU)]. 


For  convenience  we  thus  define  Ri  4  EjEi  and  Rz  4  E^Ez 
which  appear  in  subsequent  expressions.  Although  an  Lz  cross¬ 
weighting  term  of  the  form  2x‘lf)R\zUlJ)  can  also  be  included, 
we  shall  not  do  so  here  to  facilitate  the  presentation. 

For  the  Ha  performance  constraint,  the  transfer  function  (2.5) 
involves  weighting  matrices  E\a  and  Eza  for  the  state  and  control 
variables.  The  matrices  R\a  =  and  Rza  =  E^^Eza  are 

thus  the  Ha  counterparts  of  the  Lz  weights  Ri  and  Rz.  Although 
we  do  not  require  that  Ria  and  Rza  be  equal  to  /?i  and  Rt.  we 
shall  require  in  the  next  section  that  Rza  =  0^^!,  where  the 
nonnegative  scalar  jS  is  a  design  variable.  Finally,  the  condition 
E\aEi»  =  0  precludes  an  Ha  cross-weighting  term  which  again 
facilitates  the  presentation. 

Before  continuing,  it  is  useful  to  note  that  if  A  is  asymptotically 
stable  for  a  given  compensator  (Ae,  Be,  Cc),  then  the  performance 
(2.7)  is  given  by 

0 

J(Ae,  Be,  Ce)  =  tT  QR  (2.10) 

where  the  steady-state  closed-loop  state  covariance  defined  by 
g  4  lim  l[i(r)x^(0]  (2.11) 

/-•OD 

satisfies  the  n  x  n  algebraic  Lyapunov  equation 

0  =  aQ+QA'^+V.  (2.12) 

Remark  2.5:  Using  (2. 10)  and  (2. 12)  it  can  be  shown  that  the 
Lz  cost  criterion  (2.7)  can  be  written  in  terms  of  the  Lz  norm  of 
the  impujse  response  of  the  closed-loop  system.  Specifically,  by 
writing  Q  satisfying  (2,12)  as 

^  e^>?e^'^‘dt 
Jo 

(2. 10)  becomes 

7(>!c,  Be,  Ce)=  r  \\£e^'D\\):dt 

where  ||  •  ||/r  denotes  the  Frobenius  matrix  norm 
The  key  step  in  enforcing  the  disturbance  attenuation  constraint 
(2.6)  is  to  replace  the  algebraic  Lyapunov  equation  (2.12)  by  an 
algebraic  Riccati  equation  which  overbounds  the  closed-loop 
steady-state  covariance.  Justification  for  this  technique  is  pro¬ 
vided  by  the  following  result. 

Lemma  2. 1:  Let  (Ae,  Be,  Q)  be  given  and  assume  there  exists 
g  (gnx/5  satisfying 

Q  e  W'*  (2.13) 

and 

0=ACl,+  CL4^+7'^Cl^»Q,+  l^.  (2.14) 

Then 

(A,  D)  is  stabilizable  (2.15) 

if  and  only  if 

A  is  asymptotically  stable.  (2.16) 

In  this  case,  * 

l|//(^)||»S7  (2.17) 

and 

esCi. 


(2.18) 
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Consequently, 

J{Ae,Be,Ce)£3{Ae,Be,Ce,  Q.) 

(2.19) 

where 

S{Ae,  Be,  Ce,  Cl)  A  tr  d^. 

(2.20) 

Pmof:  It  foljows  fromJ28,  Theorem  3.6]  that  (2. 15)  implies 
that  (A,  [y~^Q.Ra>Q.  +  is  also  stabilizable.  Using  the 

assumed  existence  of  a  nonnegative-definite  solution  to  (2. 14)  and 
[28,  Lemma  12.2],  it  now  follows  that  .4  is  asymptotically  stable. 
The  converse  is  immediate.  The  proof  of  (2. 17)  follows  from  a 
standard  manipulation  of  (2.14);  for  details  see  [29,  Lemma  1]. 
To  prove  (2.18),  subtract  (2.12)  from  (2.14)  to  obtain 

0  =  ^(Cl-Q)  +  (Cl-g).4’"+7-2<5.«„(9.  (2.21) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

Q.-Q=  (“  d/aO.  (2.22) 

Jo 

Finally,  (2.19)  follows  immediately  from  (2.18).  □ 

Remark  2.6:  Note  that  (2.15)  is  actually  a  closed-loop 
disturbability  condition  which  is  not  concerned  with  control  as 
such.  This  condition  guarantees  that  the  system  does  not  possess 
undisturbed  unstable  modes.  Of  course,  if  V  is  positive  definite  or 
{A,  S)  is  controllable,  then  (2.15)  is  satisfied. 

Lemma  2.1  shows  that  the  //*  disturbance  attenuation  con¬ 
straint  is  automatically  enforced  when  a  nonnegative-definite 
solution  to  (2. 14)  is  known  to  exist  and  A  is  asymptotically  stable. 
Furthermore,  all  such  solutions  provide  upper  bounds  for  the 
actual  closed-loop  state  covariance  Q  along  with  a  bound  on  the  Li 
performance  criterion.  Next,  we  present  a  partial  converse  of 
Lemma  2. 1  which  guarantees  the  existence  of  a  unique  minimal 
nonnegative-definite  solution  to  (2.14)  when  (2.17)  is  satisfied. 
The  minimal  solution  is  desirable  since  it  yields  the  least 
performance  bound  in  (2.19).  This  was  first  pointed  out  in  [45]. 

Lemma  2.2:  Let  {Ac,  Be,  Q)  be  given,  suppose  A  is 
asymptotically  stable,  and  assume  the  disturbance  attenuation 
constraint  (2. 17)  is  satisfied.  Then  there  exists  a  unique  nonnega¬ 
tive-definite  solution  0,  satisfying  (2.14)  and  such  that  A  + 
y~^Q.Ra,  is  asymptotically  stable.  Furthermore,  this  solution  is 
also  minimal. 

Proof:  The  result  is  an  immediate  consequence  of  [30,  pp. 
150  and  167],  using  Theorems  3  and  2,  along  with  the  dual 
version  of  [28,  Lemma  12.2].  The  proof  of  minimality  is  given  in 
[29].  ^  □ 

Remark  2. 7:  To  further  clarify  the  relationships  between  the  Li 
and  H„  aspects  of  the  problem,  we  note  that  the  closed-loop 
system  can  be  represented  by  two  possibly  different  transfer 
ftinctions.  Specifically,  with  respect  to  the  Li  cost  criterion,  the 
closed-loop  transfer  ftinction  between  disturbances  and  controlled 
variables  is  given  by  the  triple  {A,  D,  £)  while  for  the 
constraint  the  closed-loop  transfer  function  (2.5)  corresponds  to 
the  triple  (A,  D,  £,f). 

Finally,  it  can  be  shown  that  the  closed-loop  Riccati  equation 
(2.14)  also  enforces  a  constraint  on  the  norm  of  the  Hankel 
operator  corresponding  to  the  closed-loop  system  {A,  D,  £„) 
when  Q,  is  positive  definite.  Thus,  let  P  6  13"  denote  the  solution 
to 

0=A'’'P+PA+Rc„  (2.23) 

and  note  that  P  and  Q  [satisfying  (2. 12)]  are  the  observability  and 
controllability  Gramians,  respectively,  of  the  system  {A,  D,  £j). 
As  showji  in  [31],  the  norm  of  the_Hankel  operator  corresponding 
to  {A,  D,  £„)  is  given  by  XJ^^(P0. 

Proposition  2.1:  Suppose  there  exists  Q,  G  ?"  satisfying 


(2.14)  and  such  that  (2.15)  or,  equivalently,  (2.16)  holds.  Then 

\]Z(PQ)^y-  (2.24) 

Proof:  Since  Q,  is  assumed  to  be  invertible,  (2.14)  is 
equivalent  to 

0=72^rQ^-'  +  72Q-'^H-72Q-iKQ-i  +  /?..  (2.25) 

Subtracting  (2.23)  from  (2.25)  shows  that  7^(5,*'  -  P  >  0,  or, 
equivalently,  y^I^  >  Q'/zpQ.'-'l  Thus, 

7^^X™(Cl''^PCl'^^)  =  )w(P'^2ClP‘/2)>>^(p./2Qpi/2) 

=w^e) 

which  yields  (2.24).  □ 

III.  The  Auxiliary  Minimization  Problem  and  Necessary 
Conditions  for  Optimality 

As  discussed  in  the  previous  section,  the  replacement  of  (2.12) 
by  (2. 14)  enforces  the  disturbance  attenuation  constraint  and 
yields  an  upper  bound  for  the  Li  performance  criterion.  That  is, 
given  a  compensator  {Ac,  Be,  Q)  for  which  there  exists  a 
nonnegative-definite  solution  to  (2. 14),  the  actual  Li  performance 
J{^c,  Be,  Cc)  of  the  compensator  is  guaranteed  to  be  no  worse 
than  the  bound  given  by  3(/l„  Q,  Cl).  Hence,  3(/lc.  Be,  Q, 
Cl)  can  be  interpreted  as  an  auxiliary  cost  which  leads  to  the 
following  mathematical  programming  problem. 

Auxiliary  Minimization  Problem:  Determine  {Ac,  Be,  Ce,  Cl) 
which  minimizes  &{Ae,  Be,  Ce,  Cl)  subject  to  (2.13)  and  (2.14). 

It  follows  from  Lemma  2.1  that  the  satisfaction  of  (2.13)  and 
(2  14)  along  with  the  generic  condition  (2. 15)  leads  to;  1)  closed- 
loop  stability;  2)  prespecified  //„  performance  attenuation;  and  3) 
an  upper  bound  for  the  Li  performance  criterion.  Hence,  it 
remains  to  determine  {Ac,  Be,  Ce)  which  minimizes  J{Ac,  Be, 
Cc,  Cl),  and  thus  provides  an  optimized  bound  for  the  acnial  Lj 
performance  J{Ae,  Be  Ce).  Rigorous  derivation  of  the  necessary 
conditions  for  the  auxiliary  minimization  problem  requires  addi¬ 
tional  technical  assumptions.  Specifically,  we  restrict  {Ac,  Be, 
Cc,  Cl)  to  the  open  set 

9C  A  {{Ac,  Be,  Ce,  Cl)  :  Cl  e  A+y-^Q,Ree 
is  asymptotically  stable, 

and  {Ac,  Be,  Cc)  is  controllable  and  observable}.  (3.1) 

Remark  3.1:  The  set  9C  constitutes  sufficient  conditions  under 
which  the  l^grange  multiplier  technique  is  applicable  to  the 
auxiliary  minimization  problem.  Specifically,  the  requirement 
that  Cl  be  positive  definite  replaces  (2.13)  by  an  open  set 
constraint,  the  stability  oi  A  +  y~^Q,Re„  serves  as  a  normality 
condition,  and  {Ac,  Be,  Ce)  minimal  is  a  nondegeneracy  condi¬ 
tion.  Note  that  the  stabilizability  condition  (2.15)  and  stabibty 
condition  (2.16)  play  no  role  in  determining  solutions  of  the 
auxiliary  minimization  problem. 

The  following  result  presents  the  necessary  conditions  for 
optimality  in  the  auxiliary  minimization  problem.  The  proof  of 
this  result  is  given  in  the  Appendix  as  a  special  case  of  the 
corresponding  result  for  reduced-order  dynamic  compensation 
considered  in  Section  VI.  As  mentioned  previously,  we  assume 
that/?2oo  =  ff^Rz,  where/?  2:  0.  Furth'fermore,  for  arbitrary  0,  P 
€  33"  define 

S  A  {I„+^^y-^(^P)-K  (3.2) 

Since  the  eigenvalues  of  QP  coincide  with  the  eigenvalues  of  the 
nonnegative-definite  matrix  P'  ^QP'  ^  it  follows  that  QP  has 
nonnegative  eigenvalues.  Thus,  the  eigenvalues  of /„  + 
are  all  greater  than  one  so  that  the  above  inverse  exists. 
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Theorem  3.1:  If  Q,  <i)  S  9C  solves  the  auxiliary 

minimization  problem  then  there  exist  Q,  P,  ^  €  W"  such  that 


Ae=A-Qt-lPS+y-^QR^a, 

(3.3) 

Be=QC-rV-\ 

(3.4) 

Cc=-Pj-'5^P5, 

(3.5) 

L  2  cj 

(3.6) 

and  such  that  Q,  P,  Q  satisfy 

0=AQ+QA^+Vi+y-‘^QR^ 

(3.7) 

0=(/l+7-MQ+ei/Ji»)^P+/’(>l+7-HQ+^]^io.) 

+  P,-S^PSPS,  (3.8) 


0=(^-rP5+7-2QP,«)^+^(/l-2PS+7-2(2P,o.)^ 

+7"^^(^i»  +  ^^S^PSP5)^+Q£Q.  (3.9) 

Furthermore,  the  auxiliary  cost  is  given  by 

3(/tc.  Cc.  Q)  =  tr  [(Q  +  ^)P,  +  ^S^P2PS].  (3.10) 

Conversely,  if  there  exist  Q,  P,  ^  €  ?]"  satisfying  (3.7)-(3.9), 
then  {Ac,  Be,  C„  Q,)  given  by  (3.3)-(3.6)  satisfies  (2.13)  and 
(2.14)  with  auxiliary  cost  (2.20)  given  by  (3.10). 

Remark  3.2:  If  Q  and  are  nonnegative  definite,  then  the  fact 
that  the  definiteness  condition  (2. 13)  is  satisfied  can  easily  be  seen 
by  writing  Q.  as 

As  mentioned  in  Section  II,  it  is  desirable  to  determine  solutions  Q 
and  ^  which  yield  the  minimal  solution  to  (2. 14). 

Remark  3.3:  Setting  0  =  0,  or  equivalently,  Ei„  =  0, 
specializes  Theorem  3. 1  to  the  cheap  Ha,  control  case  in  which 
Ha  anenuation  between  dismrbances  and  controls  is  not  con¬ 
strained.  In  this  case  S  =  I„,Q.  is  given  by  (3.6),  and  (3.3)-(3.5) 
become 

Ac=A-Qt-'ZP+y-^QRia.  (3.11) 

Bc=QC^y^\  (3.12) 

Cc=-R^'B^P  .  (3.13) 

where  Q  satisfies  (3.7),  and  (3.8)  and  (3.9)  become 

0  =  {A+y-HQ+Q]R,aVP+P{A+y-^[Q  +  Q]Ria) 

+  R1-PIP,  (3.14) 

0={A-'ZP+y-^QRfa)C  +  Q{A-2P+y-^QRia)^ 

+7-'^/?i-(3+Q22.  (3.15) 

Finally,  the  auxiliary'  cost  reduces  to 

SiAc,  Be,  Ce,  Q.)  =  tr  (((2+^)Pi  +  ^PSP].  (3.16) 

Numerical  solution  of  (3.7),  (3.14),  and  (3.15)  is  discussed  in 
Section  VIII. 

Remark  3.4:  Note  that  if  both  )3  =  0  and  Pi,,  =  0,  then 
Theorem  3.1  specializes  to  the  standard  LQG  result. 

Theorem  3.1  presents  necessary  conditions  for  the  auxiliary 
minimization  problem  which  explicitly  synthesize  extremaLcen- 
trollers  {Ae,  Be,  Ce).  These  necessary  conditions  comprise  a 


system  of  three  modified  algebraic  Riccati  equations  in  variables 
Q,  P,  and  The  Q  and  P  equations  are  similar  to  the  estimator 
and  regulator  Riccati  equations  of  LQG  theory,  while  the  ^ 
equation  has  no  counterpart  in  the  standard  theory.  Note  that  the 
Q  equation  is  decoupled  from  the  P  and  ^  equations  and  thus  can 
be  solved  independently.  The  P  equation,  however,  depends  on 
Q.  Thus,  regulator/estimator  separation  holds  in  only  one 
direction  which  clearly  shows  that  the  certainty  equivalence 
principle  is  no  longer  valid  for  the  L^/Ha  design  problem. 
Furthermore,  since  die  P  and  equations  are  coupled,  they  must 
be  solved  simultaneously.  Finally  ,  note  that  if  the  disturbance 
attenuation  constraint  is  sufficiently  relaxed,  i.e.,  7  -*  00,  then  the 
P  equation  becomes  decoupled  from  the  Q  equation  and  thus  the 
Q  equation  becomes  superfluous.  Furthermore,  the  remaining  Q 
and  P  equations  separate  and  coincide  with  the  standard  LQG 
result. 

IV.  Sufficient  Conditions  for  Disturbance  Attenuation 

In  this  section  we  combine  Lemma  2. 1  with  the  converse  of 
Theorem  3.1  to  obtain  our  main  result  guaranteeing  closed-loop 
stability,  Ha  disturbance  attenuation,  and  an  optimized  Li  per¬ 
formance  bound. 

Theorem  4.1:  Suppose  there  exist  Q,  P,  <5  G  53"  satisfying 
(3^7)-(3.9)  and  let  {Ae,  Be,  C^,  Q.)  be  given  by  (3.3)-(3.6).  Then 
{A,  D)  is  stabilizable  if  and  only  if  A  is  asymptoticdly  stable.  In 
this  case,  the  closed-loop  transfer  function  H{s)  satisfies  the  Ha 
attenuation  constraint 

I|H(s)|US7  (4.1) 

and  the  Z.^  performance  criterion  (2.7)  satisfies  the  bound 

J{Ae,  Be,  C,)Str  [{Q+Q)Rt  +  ^S^PSPS).  (4.2) 

Proof:  7'he  converse  portion  of  Theorem  3.1  implies  that  Q, 
given  by  (3.6)  satisfies  (2.13)  and  (2. 14)  with  auxiliary  cost  given 
by  (3. 10).  It  now  follows  from  Lenuna  2. 1  that  the  stabilizability 
condition  (2.15)  is  equivalent  to  the  asymptotic  stability  of  A,  the 
Ha  disturbance  attenuation  constraint  (2.17)  holds,  and  the 
performance  bound  (2.19),  which  is  equivalent  to  (4.2),  holds. 

□ 

Remark  4.1:  In  applying  Theorem  4.1  it  is  not  actually 
necessary  to  check  (2.15)  which  holds  genetically.  Rather,  it 
suffices  to  check  the  stability  oiA  directly  which  is  guaranieed  to 
be  equivalent  to  (2. 15). 

In  applying  Theorem  4. 1  the  principal  issue  concerns  condi¬ 
tions  on  the  problem  data  under  which  the  coupled  Riccati 
equations,  f3.7)-(3.9)  possess  nonnegative-definite  solutions. 
Clearly,  for  7  t  ftiotcsitiv  large,  (3.7)-(3.9)  approximate  the 
standard  LQLi  ",  s*  so  that-ixistence  is  assured.  The  important 
case  of  interest,  .icwever,  involves  small  7  so  that  significant  Ha 
disturbance  attenuation  is  enforced.  Thus,  if  (4. 1)  can  be  satisfied 
for  a  given  7  >  0,  it  is  of  interest  to  know  whether  one  such 
controller  can  be  obtained  by  solving  (3.7)r(3.9).  Lemma  2^2 
guarantees  that  (2.14)  possesses  a  solution  for  any  controller 
satisfying  (2.17).  Thus,  our  sufficient  condition  will  also  be 
necessary  as  long  as  the.auxiliary  minimization  problem  possesses 
at  least  one  extremal  over  9C.  When  this  is  the  case  we  have  the 
following  immediate  result. 

Proposition'4.1:  Let  7*-denote  the  infimuiti  of=!I//(s)l|o.  over 
all  stabilizing  nth-order  dynamic  compensators.and  suppose  that 
the  auxiliary  minimization  problem  has  a  solution  for  all  7  >  7*. 
Then  for  all  7  >  7*  there  exist  Q,  P,  (5  €  M"  satisfying  (3.7)- 
(3.9). 

Unlike  the  standard  LQG  result  involving  a  pair  of  separated 
Riccati  eq'uations,  the  new  result  enforcing  Ha  disturbance 
at-enuation  involves  a  nonstandard  coupled  system  of  three 
modified  Riccati  equations.  The  asymmetry  of  these  equations 
suggests  the  possibility  of  a  dual  result  in  which  the  modifications 
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to  the  standard  P  and  Q  Riccati  equations  are  reversed.  Such  a 
dual  result  will  generally  be  different  from  Theorem  4. 1  and  thus 
will  yield  an  improved  bound  for  particular  problems.  This  point 
was  demonstrated  in  [16]  for  the  problem  of  robust  performance 
analysis.  Due  to  space  limitations,  however,  we  give  only  a  brief 
outline  of  the  dual  results.  Note  that  J(Ac,  Be,  Q)  given  by 
(2. 10)  is  also  given  by 

J(Ac,Bc,Cc)^tTPV  (4.3) 

where  P  G  13"  is  the  unique  solution  to  (2.23)  with  P*  replaced 
by  R.  Next,  utilizing  (4.3)  in  place  of  (2.10),  the  He  disturbance 
attenuation  constraint  (2.6)  can  now  be  enforced  by  repl'Wing 
(2.23)  by  the  Riccati  equation 

0=A^(P  +  <PA-i-y-'^(?Ve(P  +  R  (4.4) 

wliere  has  the  same  form  as  V  but  may  involve  weights 
and  Vie.  Note  that  (4.4)  is  merely  the  dual  of  (2.14).  We  also 
require  the  condition  dud  to  (2.15)  given  by 

(E,  A)  is  detectable  (4.5^ 

and  that/4  +  y~^9e<S‘  be  asymptotically  stable.  Once  again,  the 
sufficient  conditions  for  He  disturbance  attenuation  involve 
coupled  system  of  three  modified  Riccati  equations  dual  to  (3.7j-- 
(3.9).  Similar  remarks  apply  to  Ae  rei^ced-order  c^e  given  by 
Theorem  6. 1  below^  Finally,  jf  Re  =  R  and  =  9,  then  it  can 
be  shown  that  tr  (5.P  =  tr  P  and  thus  the  solutions  to  the  primal 
and  dual  problems  coincide. 

V.  Alternative  Forms  of  the  Riccati  Equations 

In  this  section  we  develop  alternative  forms  of  the  Riccati 
equations  (3.7)-(3.9).  These  alternative  forms  provide  further 
insight  into  the  structure  of  (3.7)-(3.9)  and,  in  certain  cases,  are 
simpler  and  thus  are  easier  to  solve  computationally.  This  section 
also  provides  connections  betwer  n  our  approach  and  [26]. 

First  we  note  that  the  gains  (3.3),  (3.5),  and  (i  do  not 
depend  upon  P  and  Q  individually,  but  rather  only  up-m  the  term 
Z  4  PS.  Thus,  it  is  of  interest  to  know  whether  (3.8)  and  (3.9) 
can  be  transformed  to  yield  an  equation  which  characterizes  Z 
directly.  The  following  result  summarizes  useful  properties  of  Z. 

Lemma  5.1:  Let  P,  ^  G  ?J"  and  define  Z  4  PS.  Then  Z  = 
Z^  =  S^P,  where  Sf  =  (/„  +  &^-'^PQ)-\  and  Z  is 
nonnegative  definite.  If,  in  addition,  P  is  positive  definite,  then  Z 
is  positive  definite  and 

Z=(P-'+j327-2(5)-'.  (5.1) 

Proof:  The  result  (5.1)  is  immediate.  The  remaining  results 
can  be  obtained  by  replacing  P  by  P  +  where  e  >  0,  and 
taking  the  limit  as  £  -»  0.  □ 

Proposition  5.1:  Let  Q  G  JO"  and  suppose  there  exist  P  G  ?" 
and  Q  G  satisfying  (3.8)  and  (3.9).  Then  Z  k  PS  satisfies 

(i={A+y--^QR^e+y-^Q{R\o,-fi^Rx])^Z 
+  Z(/4  +7-^Q/?ic.+7-^^[/?i<.-0"Pi]) 

+  P,-Z(2+/S27-^^[P,„-^2P,](5)Z 

+fi^y-^ZQtQZ  (5.2) 

and  (3.9)  is  equivalent  to 

0  =  (A-'ZZ-Ty-^QR,e)^  +  Q{A-SZ+y-^QRiey 

+y-^Q(.R,c+P^ZSZ)>;>+Q2Q.  (5.3) 
Furthermore,  (3.3),  (3.5),  and  (3.10)  become 

Ac=A-Q2-SZ+y-'-QR^„,  (5.4) 


Cc=-R{'B^Z,  (5.5) 

9iAc,  Be,  Ce,  q.)  =  tr[(Q+^)P,  +  ^Z2Z].  (5.6) 

Proof:  Using  the  identities 

P={.In-&^y-^Z&-'Z=Z(I„-&'‘y-^^Z)-^ 

which  follow  from  (5.1),  equation  (5.2)  can  be  obtained  by 
forming  the  new  equation 

<  .  «27-^ZC)(3.8)(/„-/327-2^Z)+i327-2Z(3.9)Z.  (5.7) 

Tinsli.,  j)-(5.5)  are  restatements  of  (3.9),  (3.3),  and  (3.5) 

>  c  Z  •  P.9,  □ 

'll- /r.tined  a  single  equation  (5.2)  for  Z  =  PS  by 
i.  '-il-  i  (:i.8)  and  (3.9)  for  P  and  Q,  :t  is  of  interest  to  know 
whijl  *.  (3.8)  for  P  can  be  recovered  from  (5.2)  and  (5.3). 

Pi  position  5.2:  Let  2  G  JO",  j3  >  0,  suppose  there  exist  Z  G 
(P"  p  •  >1  <5  G  13"  satisfying  (5.2)  and  (5.3),  and  assume  that 

p(Z&<p-^y\  (5.8) 

The.  i  4  (Z"'  -  /3^"^^)"'  is  positive  definite  and  satisfies 

(3.8) .  Furthermore,  P  satisfies  Z  =  PS. 

Proof:  If  (5.8)  holds,  then  it  can  be  shown  that  P  as  defined 
above  is  positive  definite. -Reversing  the  proof  of  Proposition  5. 1 , 

(3.8)  can  bt)  recovered  by  forming 

(/„ - -^ZQ)-\(S.2) -  0^y -^Z(5.3)Z](I„ - 0^y -^QZ)-'.  □ 

Although  Proposition  5.2  allows  us  to  reconstruct  (3.8)  forP,  it 
can  only  bs  utilized  when  (5.8)  holds.  This  fact  raises  a  question 
as  to  the  sufficiency  of  (3.7),  (5.2),  and  (5.3)  in  the  absence  of 

(3.8) .  It  turns  out  that  the  matrices  P  and  Z  need  not  actually 
satisfy  (3.8)  and  (5.2)  to  enforce  tS-e  He  performance  constraint 
(2.17)  since  only  the  Q  and  ^  equatious  are  required.  Rather,  P 
can  be  viewed  as  a  paraLneterization  of  Z  which,  in  turn,  is  a 
parameterization  of  the  ga..!S  Ae  and  Ce  given  by  (5.4)  and  (5.5) 
which  yield  a  controller  satisfying  the  desired  He  performance. 
These  observations  are  summarized  by  the  following  result  which 
does  not  require  that  Z  be  obtained  by  solving  (5.2). 

Proposition  5.3:  Let  Z  G  13"  and  suppose  there  exist  Q,  Q  G 
13"  satisfying  (3.7)  and  (5.3).  Then  (Ae,  Be,  Ce,  0.)  given  by 
(5.4),  (3.4),  (5.5),  and  (3.6)  satisfy  (2.13)  and  (2.14).  Thus, 
(2.15)  and  (2.16)  are  equivalent,  and,  in  this  case,  (2.17)  and 
(2.19)  hold. 

Proof:  The  result  follows  by  direct  verification  of  (2.14).0 
Proi»sition  5.3  shows  that  the/f®  constraint  (2.17)  is  enforced 
for  arbitrary  Z  G.  13"  as  long  as  (3.7)  and  (5.3)  can  be  solved  for 
Q  and  Q.  The  price  we  pay  for  using  arbitrary  Z  is  that  we  no 
longer  are  assured  that  Z  is  obtained  from  (5.2)  or  from  Z  =  PS 
where  P  satisfies  (3.8).  Since  P  arises  from  the  Lagrange 
multiplier  for  the  constraint  (2.14)  [see  (A.3)],  it  follows  that  an 
arbitrary  choice  of  P  (or  Z)  may  fail  to  minimize  the  auxiliary 
cost  (2.20).  Thus,  regarding  P  and  Z  as  free  parameters 
effectively  ignores  the  Lz  aspect  of  Theorem  4.1. 

It  is  also  of  interest  to  introduce  yet  another  transformation  of 
(3.7)-(3.9)  by  defining 

Y  4  (Z-'+^i7-20-'  =  (p-'+^2-y-2[Q+<5))-i(5.9) 

when  P  is  positive  definite.  As  in  Len'm.i  5.1,  T  i;  .siso.positive 
definite. 

Proposition  5.4:  Let  Q  G  13"  and  suppose  there  exist  P  G  ?" 
and  Q  G  13"  satisfying  (3.8)  and  (3.9).  Then  7  defined  by  (5.9) 
satisfies 

(^=(A+y-^[Q+Q][Rie-9^Ri])^Y 
+  7(/4+7-2(Q+0[P,„-0Jp,]) 
4-Rx+p^y-'-YV^Y-YtY 
-0^y-^  Y(Q+&(Rie-0^R,)(Q+^)  Y 


(5.10) 
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and  (3.9)  is  equivalent  to 

0=(/l-S[r-'-/32Y-ZQ]-'+7-2Q/?„)^ 

+  Q(A-7:[Y-'-p^y-^Q}-'+y-^QRi^r 
+y-^Q(Ri^+PHY-'-0h-^Q]-' 
•UY-'~0^y-^Q]-')C+Q2Q.  (5.11) 

Furthermore,  (3.3),  (3.5),  and  (3.10)  uecome 

/l,=/l-Q2-S(y-'^/327"^0  •‘+7“^2^1o..  (5.*2) 
Cc=-Ri'B^(Y-'-0^y-^Q)-K  (5.13) 

iK/l,,  Ce,  Cl)  =  tr  [(Q+<5)Ri 

+  (2( Y-'-fi^y-^Q) - ‘2( y-> -i3^-^Q)-'].  (5.14) 

Proof:  To  obtain  (5.10),  form 

y[Z-'(5.2)Z-'+/327-2(3.7)iy.  □ 

The  following  result  allows  us  to  recover  (3.8)  for  P  from 
(5.10)  and  (5.11). 

Proposition  5.5:  Let  Q  S  53",  /3  >  0,  suppose  there  exist  Y  € 
i?"  and  ^  G  53"  satisfying  (5.10),  (5.11),  and  assume  that 

P(TIQ+(53)<13-V.  (5.15) 

Then  P  4  (Y~'  -  0'^y'\Q  +  C])~'  *s  positive  definite  and 
satisfies  (3.8). 

Proof:  The  result  follows  by  reversing  the  proof  of 
Proposition  5.4.  □ 

By  specializing  further,  it  is  possible  to  achieve  even  greater 
simplification.  Specifically,  we  consider  the  case  in  which  the  Li 
and  Hm  weights  are  equalized,  i.e., 

/?i.=/?i,|3=l.  •  'Si 

In  this  case  it  is  always  possible  to  eliminate  (5.3)  and  (5.1.)  by 
noting  that  they  are  satisfied  by  ^  =  7^Z"‘  and  ^  =  y^Y~^  — 
Q,  respectively.  However,  although  thi.s  solution  enforces  the 
constraint,  it  can  be  seen  from  the  resulting  form  of  S  that  this 
solution  does  not  correspond  to  the  minimal  solution  ^of  (2.14). 
Hence,  we  impose  additional  assumptions  wluch  allow  us  to 
directly  characterize  the  solution  which  yields  the  minimal 
performance  bound.  Wc  are  indebted  to  D.  Mustafa  for  clarifying 
this  point  in  [45]  whenr  it  is  also  shown  that  the  auxiliary  cost 

(2.20)  i.%  equivalent  to  aji  t.ntropy  integral. 

Proposition  5.6:  Asrome  (5.16)  is  satisfied,  suppose  there 
exist  <2  G  53"  and  Z*  G  P"  satisfying 

0=AQ+QA^+  Vi+y-^QRi^Q-QtQ,  (5.17) 

0  =  (/!  +  7  -iQ.^,»)  ^Z»  +  Z.(/l  +  7  -"QR,.) 

+  i?,„-Z,2Z„+7-*Z«Q2QZ<.  (5.18) 

and  such  that 

A  +7"^Q/?io.+(7“^C2Q-S)Zo,  is  asymptotically  stable 


(/1+7“^(2/?io>  +  Z"‘5?|*,  7"'[5?io.  +  Z«SZai]''^)  is  observable. 

(5.20) 

Furthermore,  let  {Ac,  Be,  Q)  be  given  by 

(5.21) 
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5c=gC^Kj>,  (5.22) 

Cc=-RiJlB^Za,.  (5.23) 

Then  (A,  D)  is  stabilizable  if  and  only  if  A  is  asymptotically 
stable.  In  this  case,  the  closed-loop  transfer  function  H{s) 
satisfies  the  Ha,  dismrbance  attenuation  constraint 

il^(^)IU^7  (5.24) 

and  the  Lz  performance  criterion  (2.V)  satisfies  the  bound 

J{Ac,  Be,  Ce)£ti[QRia,-i  QtQZ.^].  (5.25) 

Proof:  First  note  that  it  follows  from  (5  i8)  that 

~{A+y~'^QRxa.+ZZ^Ria,)  =  Za,[A  +  y'^QRxa. 

+  (t‘^G2q-S)Z«]Z;'  (5.26)  S 

and  thus  (5.19)  implies  that  —{A  +  y~~‘QR\a,  +  Z~^Ria,)  vs 
asymptotically  stable.  It  now  folio  ,vs  from  (5.20)  that  there  exists 
Af  G(?"  satisfying 

0=-(/l+7-^Q/f.«  +  Z;‘/?,«)rA/-A/(.4  +  7-^g«i« 

+  Z;*/?,.)+7-^(/?,„  +  Z«SZ«).  (5.27) 

It  can  now  be  shown  that  ^  =  7^Z;'  -  N"'  satisfies  (5.3)  with 
/3  =  1  .and  Z  =  Z*.  Furthermore,  (5.8)  is  satisfied  so  thafthe 
hypotheses  of  Theorem  4. 1  are  verified.  The  expression  (5.25) 
now  follows  by  direct  substitution.  " 

Finally,  we  consider  a  simplified  version  of  Proposition  5.4. 
Proposition  5.7:  Assume  (5.16)  is  satisfied  and  suppose  there 
exist  Q  G  53"  and  y«  G  !?"  satisfying 

0^AQ+QA^+Vi+y-^QRx„Q-QtQ,  (5.28) 

0=/l’‘y.+  Y^A+Riaa+y-^YaaVi  Ya,-Y„2Ya.,  (5.29) 

p(Qy-)<7*  (5.30) 

and  such  that 

yd  +  (7 Ki  -  S)  To,  is  asymptotically  stable  (5.31) 

and 

(/H-y;%«,7-'[i?,«+(y;'-7-2e)-> 

•  2(y;'-7‘^Q)l''^)i5  observable.  (5.32) 

Furthermore,  let  {Ae,  Be,  Q)  be  given  by 

Ae=A-Q2--Z{Y-'-y-^Q)-'+y-^QRx,.,  (5.33) 

Be=QC^y^'.  (5.34) 

Ce=-R^JlBTriYz'-y-^Q)-'.  (5.35) 

Then  {A,  D)  is  stabilizable  if  and  only  if  A  is  asymptotically 
stable.  In  this  case,  the  closed-loop  transfer  function  .^(s)-:alisfies 
the  /fa  disturbance  attenuation  constraint 

1|H(s)1U:S7  (5.36) 

and  the  Li  performance  criterion  (2.7)  satisfies  the  bound 

HAe,  Be,  CeUmRio.+QtQ{Yz'-y-^Q)-'].  (5.37) 

Proof:  The  proof  is  similar  to  the  proof  of  Proposition  5.6 
with  Q  =  y^Ya,  -  Q  -  where satisfies 

0=  -{A  +  Yl^Rxa.VlSl-N{A  +  y;'/?,„) 

+7-^(^i-+(>';'-7-2g)-'S(y;'-7-^Q)-'I.  □ 


Ae=A-Q%-'LZa,+y-^QRxa., 
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Remark  5.1:  The  solutions  Q  and  y*  of  (5.28)  and  (5.29)  are 
analogous  to  the  matrices  To.  and  Xa,  of  [26],  while  (5.30) 
corresponds  to  condition  5.2(iii)  of  [26].  Note  that  by  letting  y 
00,  (5.25)  and  (5.37)  coincide  with  5-77a  of  [1]  and  the  LQG 
result  is  recovered. 

Remark  5.2:  It  is  interesting  to  note  that  (5.17)  and  (5.18)  with 
controller  gains  (5.21)-(5.23)  are  already  known  since  they  are 
identical  to  the  optimality  conditions  for  the  linear-exponential-of- 
quadratic-Gaussian  problem  treated  in  [33]  (see  also  [34]  and 
[35]).  Specifically,  see  (3.1)  and  (4.1)  on  pp.  603  and  609, 
respectively.  As  shown  in  [33],  minimizing  the  criterion 

J=  lim 

leads  to  the  pair  of  modified  Riccati  equations  (5.17)  and  (5.18) 
with  y~^  replaced  by  fi.  This  implies  that  the  exponential-of- 
quadratic  design  problem  effectively  enforces  a  bound  of  ;t“''^  on 
the  //o.  norm  of  the  closed-loop  transfer  function.  There  aJso  exist 
fundamental  connections  with  the  problem  of  entropy  maximiza¬ 
tion  [43]-[45]. 

VI.  Extensions  TO  Reduced-Order  Dynamic  Compensation 

In  this  section  we  extend  Theorem  4.1  by  expanding  the 
formulation  of  Section  ni  to  allow  the  compensator  to  be  of  fixed 
dimension  which  may  be  less  than  the  plant  order  n.  Hence,  in 
this  section  define  fi  =  n  +  ric,  where  <  n.  As  in  [21]  this 
constraint  leads  to  an  oblique  projection  which  introduces 
additional  coupling  in  the  design  equations  along  with  an 
additional  equation.  The  following  lemma  is  required. 

Lemma  6.1:  Let  Q,  P  €  and  suppose  rank  QP  =  /»,.  Then 
there  exist  w,  x  nG,  F,  and  rtc  X  rie  invertible  M,  unique  except 
for  a  change  of  basis  in  7l\  such  that 


Cp^G^MT, 

(6.1) 

VG^=Ine- 

(6.2) 

Furthermore,  th.e  /z  X  n  matrices 

• 

T  A  g’'F, 

(6.3) 

1 

<JII 

(6.4) 

aiv  idempotent  and  have  rank  iie  and  n  - 

tie,  respectively. 

Proof:  Conditions  (6.1)-(6.4)  are' a  direct  consequence  of 
[36,  'iheorcm  6.2.5].  _  □ 

Theorem  6.1:  Let  tic  <  n,  suppose  there  exist  Q,  Py  P  E 
50"  satisfying 

0=AQ+QA  Vi  +y-^QRi^Q-Q2Q+T^  QtQrl,  (6.5) 

0  =  iA+y-HQ-^Q]Ri:.VP+P{A+y-HQ+^]Ria.)  +  Ri 

-S^PIPS+tIS^PIPSt^,,  (6.6) 

0=(A-2PS+y-^QR,^)^+^{A~lPS+y-^QRi^y 

•yy-^6(Rii,-h0'-S^P7:PS)^+Q2Q-T^Q2QTl ,  (6.7) 
0={A-Q2+y'^QRi^yP+P(A-Qt+y-^QRi„) 

+ S  ^PlPS-rl  S  ^PIPStj,  ,  (6.8) 

rank  (3=rank  ^=rank  QP=nc 


«=  rfr>-]  ■ 

Then,  (A,  D)  is  stabilizable  if  and  only  if  ^4  is  asymptotically 
stable.  In  this  case,  the  closed-loop  transfer  function  His)  satisfies 
the  Ha,  disturbance  attenuation  constraint 

||/f(^)|U:£7  (6.14) 

and  the  Lz  performance  criterion  (2.7)  satisfies  the  bound 

JiAc,  Be,  C,:):Str[(Q+^)Ri  +  ^5^P2P5].  (6.15) 

Remark  6.1:  It  is  easy  to  see  that  Theorem  6.1  is  a  direct 
generalization  of  Theorem  4. 1 .  To  recover  Theorem  4. 1 ,  set  ttc  = 
n  so  that  t  =  G  =  F  =  /„  and  Tj.  =  0.  In  this  case  the  last  term 
in  each  of  (6.5)-(6.8)  can  be  deleted  and  (6.8)  becomes 
superfluous.  Furthermore,  (6.5)-(6.7)  now  reduce  to  (3.7)-(3.9), 
as  expected.  If,  furthermore,  j3  =  0  then  S  =  I„  so  that  (6.5)- 
(6.7)  now  reduce  to  the  cheap  Ha,  control  case  given  by  (3.7), 

(3.14) ,  and  (3.15).  Alternatively,  setting  7  =  oo  and  retaining  the 
reduced-order  constraint  tie  <  n  yields  the  result  of  [21]. 

Remark  6.2: By  introducing  a  new  variable  Z  =  PS  =  (P~‘ 
+  i3^"^2)"'  as  in  Section  V,  (6.6)  becomes 

O=(A+y-^QR,c  +  y-^^[R„a-0^Ri])/Z 

+  Z(A+y-^Q.R,a,+y-^^[R,a.-fi^R,]) 

+R,-Z(2+/S27-^^[R,„-j32R,]^)Z  ■ 

+  r^ZSZrj,+0^y-^Z(Q2Q-rzQ2Qr^)Z  (6.16) 

which  specializes  to  (5.2)  when  =  rt,  i.e.,  Tj,  =  0.  When 
(5.16)  holds,  (6.16)  becomes 

0=(/l+7'*Q/?i»)^Z„+Z.(/l+7-2eR,.) 

+  7?1,,  —  Za,  SZ»  +  T  ^  Z»2Zo.  Ti 

+y-^Zo.iQ2Q-rj,Q2Qrl)Za..  (6.17) 

Analogous  equations  for  Y  defined  by  (5.9)  can  also  be 
developed. 

VII.  Analysis  of  the  Design  Equations 

Before  developing  numerical  algorithms,  it  is  instructive  to 
analyze  the  derign  equations  to  determine  existence  and  multiplic¬ 
ity  of  nonnegative-definite  solutions.  Although  a  detailed  theoreti¬ 
cal  analysis  remains  an  area  for  future  research,  in  this  section  we 
present  a  simplified  treatment  which  highlights  important  asymp¬ 
totic  properties  of  the  equations,  it  turns  out  that  several  key 
properties  are  discernible  by  considering  the  scalar  case  n  =  1. 
Although  many  of  these  properties  can  be  developed  for  general 
n,  the  simplified  scalar  case  suffices  for  obtaining  a  useful 
qualitetive  analysis.  Here  we  consider  only  (3.7),  (3.14),  and 

(3.15) . 

Since  the  Q  equation  (3.7)  is  decoupled  from  (3. 14)  and  (3. 15), 
it  can  be  analyzed  separately.  It  is  easy  to  see  that  there  exists  a 
unique  nonnegative  solution  for  7  >  (R,  /2)  as  in  the  case  of  a 
standard  Riccati  equation  with  stabilizability  and  detectability 
hypotheses.  Furthermore,..it  can  be  seen  that  for 


(6.9)  (Ri/lt  +  iA  V  K,  )J)  <7<  (^1  /2) 

there  exist  two  nonnegative  solutions  when  A  is  stable  and  zero 
nonnegative  solutions  when  A  is  unstable.  Below  this  lower  bound 

(6.10)  for  7,  nonnegative  solutions  Q  do  not  exist.  This  result  thus 
indicates  (as  in  LQG  theory  [42])  a  lower  bound  to  the  achievable 

(6.11)  Ha,  disturbance  attenuation  as  determined  by  the  sensor  noise 
intensity  Vz  appearing  in  S. 

(6.12)  Since  the  P  and  Q  equations  (3.14)  and  (3. 15)  are  coupled,  they 


and  let  (/!„  Be,  Ce,  Q.)  be  given  by 

Ae^TiA-Q2-'ZPS+y -^QR,„)G  ^ 
Be=rQC^V-', 

Ce=  -R^'B^PSG^, 
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must  be  analyzed  jointly.  Since  (3.15)  is'  a  standard  Riccati 
equation  it  follows  under  generic  hypotheses  that  it  possesses 
exactly  one  nonnegative-definite  solution  for  all  values  of  Q  and 
The  analysis  of  the  (3  equation  is,  however,  more  involved.  It 
can  be  shown  that  the  existence  of  real  solutions  is  a  complicated 
function  of  y,  Q,  and  P.  When  real  solutions  do  exist,  it  follows 
that  there  exist  either  zero  or  two  nonnegative-definite  solutions. 
To  obtain  further  qualitative  insight  into  the  solutions  P  and  we 
fix  y  and  allow  'R2  -*  0,  that  is,  the  cheap  L2  control  case.  It  thus 
follows  that  P  ~  (P,2)''>id  that  either  ~  lyH'Z/Rty'^  or 
Q  ~  1/22Q^(2Pi)"'^^>  which  correspond  to  the  previously 
mentioned  pair  of  solutions  satisfying  (3.15).  This  result  thus 
indicates  that  an  arbitrarily  small  Ha,  disturbance  attenuation 
constraint  7  can  be  achieved  [subject  to  the  solvability  of  (3.7)]  by 
sufficiently  increasing  the  L2  controller  authority.  That  is,  since 
solutions  exist  in  the  cheap  L2  control  case,  the  Ha,  disturbance 
attenuation  constraint  is  achievable.  The  ability  to  achieve  small  7 
is  also  attributable  to  the  fact  that  since  =  0,  Ha,  disturbance 
attenuation  to  the  control  variables  is  not  limited  in  (3.7),  (3.14), 
and  (3.15)  as  in  Theorems  3.1  and  6.1.  Of  course,  as  is  well 
known,  it  is  not  possible  to  make  7  -♦  0  by  letting  2  -»  00  and  2 
-» f»  when  the  system  possesses  nonminimum  phase  zeros.  Also, 
note  that  both  of  the  asymptotic  solutions  to  (3.15)  are  guaranteed 
to  yield  the  bound  (4.1).  The  solution  of  interest,  however,  is  ^ 
=  0(2"  ''^)  since  it  clearly  yields  a  lower  value  of  S(Ac,  Be,  Ce, 

£1)  than  (5  =  0(2 ''^). 


VIIl.  Numerical  Algorithm  and  Illustrative  Results 

In  this  section  we  describe  a  numerical  algorithm  which  has 
been  developed  and  implemented  for  solving  the  coupled  Riccati 
equations  (3.7),  (3.14),  and  (3.15).  We  also  present  numerical 
results  for  an  illustrative  example. 

Coupled  modified  Riccati  equations  arise  in  a  variety  of 
problems  and  homotopic  continuation  methods  have  been  shown 
to  be  particularly  successful  (23]-(25].  To  solve  (3.7),  (3. 14),  and 
(3.15)  we  have  implement^  a  simplified  continuation  method 
involving  the  constraint  constant  7.  'The  idea  is  to  exploit  the  fact 
that  for  large  7  the  problem  is  approximated  by  LQG  which 
provides  a  reliable  starting  solution.  'The  continuation  parameter  7 
is  then  successively  decreased  until  either  a  desired  value  of  7  is 
achieved  or  no  further  decrease  is  possible.  This  algorithm  is  now 
summarized.  Let  «  >  0  denote  a  convergence  criterion. 

Algorithm  8.1:  To  solve  (3.7),  (3. 14),  and  (3. 15),  perform  the 
following  steps: 

Step  1:  Initialize  7  >  0. 

Step  2:  Solve  (3.7)  for  Q. 

Step  3:  Let  A:  =  0,  (5o  =  0- 

Step  4:  Solve  (3.14)  for  Pt+i  =  P  with  Q  =  <5*. 

Step  5:  Solve  (3.15)  for  ^*+1  =  Q  with  P  =  P*+|. 

Step  6:  If  A:  s  1  check  for  ||P*+i  -  P*||  <  «  and  - 

^*1!  <  e- 

Step  7:  If  convergence  is  not  achieved  in  Step  6  (or  Ar  =  0)  let  k 
*-  k  +  1  and  go  to  Step  4;  otherwise  decrease  7  and  go  to  Step  2. 

Steps  2,  4,  and  5  were  carried  out  using  a  standard  Riccati 
solver  [37]  which  proved  to  be  reliable  even  when  the  quadratic 
term  was  indefinite  or  nonnegative  definite.  For  instance,  for  the 
example  considered  below,  the  term  7"^/2i  -  2  was  indefinite  for 
all  finite  7.  The  crucial  step  in  the  algorithm  is  the  decreasing  of  7 
in  Step  7.  Significant  effort  was  devoted  to  providing  a  smooth 
transition  to  smaller  values  of  7  without  sacrificing  computational 
efficiency.  The  development  of  more  sophisticated  continuation 
algorithms  remains  an  area  for  future  research. 

The  example  considered  was  formulated  in  [38]  and  was 
considered  extensively  in  [24],  [25],  and  [39]  to  compare  reduced- 
order  design  methods.  The  example  is  interesting  since  it 
possesses  a  complex  pair  of  nonminimum  phase  zeros  due  to  the 
fact  that  the  physical  system  (coupled  rotating  disks)  has  noncol- 
ocated  sensors  and  actuators.- The  plant  is  of  eighth  order  and  has 


two  neutrally  stable  poles.  The  problem  data  are  as  follows: 
n=«c=8,  m  =  l=l,  q^p=l. 


-0.161 

-6.004 

-0.5822 

-9.9835 

-0.4073 

-3.982 

0 
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1 

0 

0  0  0 

0  0 

0 

1 

0  6  0 

0  0 

0 

0 

1  0,  0 

0  0 

0 

0 

0  1  0 

0  0 

0 

0 

0  0  1 

0  0 

0 

0 

0  0  0 

1  0 

0 

0 

600 

0  1 

0 

0 

0  0  0 

0  0 

0 

0 

0.0064 

0.00235 

0.0713 

1.0002 

0.1045 

0.9955 


C=[l  0,x7] 


£,=£,»=  10-’ 


0  0  0  0 
0  0  0  0 


0.55 

0 


11  1.32  18l 

0  0  0  J  ■ 


£2  = 


0  =  'J. 


A  =  [fi  Osxi],  D2  =  10  1]. 


With  the  problem  data  as  given,  the  L(JG  controller  was  found 
to  yield  a  closed-loop  H,.  performance  of  1.39  (i.e.,  2.87  dB 
above  unity  gain).  Using  Algorithm  8. 1  we  obtained  a  solution  for 
7  =  0.52  for  a  net  Ha,  performance  improvement  of  8;7  dB  (see 
Fig.  1).  Note  that  this  result  is  consistent  with  [3,  Proposition  8.1] 
which  implies  that  the  maximum  ratio  of  the  performance  of 
the  optimal  L2  controller  to  the  performance  of  the  optimal 
Ha,  controller  can  be  no  more  than  twice  the  number  of  right-half- 
plane  zeros,  which  for  the  present  problem  with  two  nonminimum 
phase  zeros  corresponds  to  a^factor  of  4;(i.e.,  12  dB). 

Our  numerical  experience  revealed  two  interesting  features. 
First,  the  loop  between  Steps  4  and  6  converged  reliably. 
However,  a  critical  value  7n,i„  of  7.  v/as  invariably  found  below 
which  solutions  could  not  be  computed.  This  value  7n,!„  appears  to 
represent  the  best  achievable  Ha,  performance  for  the  given  L2 
weights.  Second,  for  each  value  of  7  >  7mi„  for  which  a  solution 
was  computed,  the  actual  //,  performance  was  close  to  this  value 
revealing  that  the  H„  bound  is  tight.  For  example,  the  actual 
worst-case  attenuation  of  the  7  =  0.52  design  shown  in  Fig.  1  is 
0.511.  Controller  characteristics  are  given  in  Table  I  and  are 
plotted  in  Fig.  2  for  several  values  of  7.  Note  that  in  each  case  the 
Z,2  performance  bound  is  within  30  percent  of  the  actual  L2 
performance. 


IX.  Further  Extensions 

The  results  obtained  herein  can  readily  be  extended  in  several 
directions.  These  include  the  treatment  of  parameter  uncertainties 
(i3]-[15],  [46],  extensions  to  controllers  with  static  feedthrough 
[32],  and  the  inclusion  of  cross-weighting  terms  (x’’(/)/?i2«(0) 
and  noise  correlation  {,D\D^  0).  Finally,  as  mentioned  in 

Remark  5.2,  connections  with  the  exponential-of-quadratic  cost 
criterion  [33]-[35]  and  entropy  maximization  [43]-[45]  are  of 
interest. 
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FREQ  IH2I 


TABLE  I 


Atuoiutioo 

CoBttmQt  7 

Actual  ifo» 

Atteauatioa 

IIHWIl-  . 

Li  Performaaca 

Bound 

J{A„8..C„a) 

Actual  Li 

Performance 

00  (LQC) 

U9 

- 

.143 

2 

1.18 

.159 

.146 

l.S 

1.C6 

.171 

.151 

1.0 

.&S5 

.204 

.166 

.9 

.797 

.217 

.176 

.732 

.235 

.187 

,T 

.861 

,262 

.»» 

.52 

.511 

.290 

.262 

Apfendix 

Proof  of  Theorem  6.1 

To  optimize  (2.20)  over  the  open  set  3C  subject  to  the  constraint 
(2. 14),  form  the  Lagrangian 

£{Ac,  Be,  Cc,  d.  (P.  X)  A  tr{X(a^+(ACl+ClA^ 

+7-2Q,^o.Cl+i^](P}  (A.l) 

where  the  Lagrange  multipliers  X  2:  0  Md  6*  €  are  not 
both  zero.  We  thus  obtain 

= (/f + 7  -zq.^0.)  '■(P  +  (P(A  +  7  +  \R.  (A.2) 

Setting  d£ldSl  —  0  yields 

0=(A+7-^Q,^,)^(P  +  (P(^+7'^<9.^=.)+X.R.  (A.3) 

Since  A  +  is  ^sumed  to  be  stable,  X  =  0  implies  = 

0.  Hence,  it  can  be  assumed  without  loss  of  generality  that  X  =  1 . 
Furthermore,  (P  is  nonnegative  definite. 

Now  partition  n  x  n  Q(£  into  n  X  n,  n  X  /ic,  and  ric  x  ric 
subblocl^  as 


Thus,  with  X  =  1  the  stationarity  conditions  are  given  by 

|^=(A+7-^CI^»)^<P  +  (P(^+7'^Q.^<.)  +  ^=0.  (A.4) 

dCJ 


^=PJ^Q^^+P^Q^=0,  (A.5) 

^=PiBc  y2+(PT2Q>+P2Qj2)C^=0.  (A.6) 

^  =  R2CcQ2  +  P^y-^R2Cc(PlQi2  +  Pl2Q2VQl2 

+BHPiQi2+Pt2Q2)  =  0.  (A.7) 
Expanding  (2.14)  and  (A.4)  yields 

0=AQt  +  QtA^+BCeQj2+Q>2ClB^+y-^QiRio.Qi 
+B^y -^Qt2C^R2CeQ[2+  K, ,  (A.8) 

0=AQi2+Qi2Aj^+BCcQ2+QiC^Bj+y~^QiRi„Qi2 
+B^y-^Q,2C^R2CcQ2.  (A.9) 

0=>4cQ2  +  Q2Af+BcCQl2  +  QfzC^^J+7“^Q^^lo.Q|2 

+Bh-^Q2C^R2CcQ2+Bcy2B[,  (A.10) 
0=A^P,+P,A  +  C^Bj'Pj'2+Pi2BcC 

+y-^RUP,Qi+Pi2Q[2)'' 

+y-HP,Qt+Pi2Q[2)Pi^+B,.  (A.11) 

0=A  ^P,2  +  Pl2Ac+C^B^P2  +  PiBCe 

+y-^R,c(Pl2Qi+PzQl2y 

+  P’y-HPlQl2+P,2Q2)C[R2Ce,  (A.12) 

0=A^P2+ P2Ac+P[2BCc + Cjfl^P,2 + Cl'R2Cc.  (A.  13) 

Lemma  A.l:  Q2  and  P2  are  positive  definite. 

Proof:  By  a  minor  extension  of  results  from  [40],  (A.  10)  can 
be  rewritten  as 

0=={Ac+BcCQnQ^)Q2+Q2(Ae+BeCQ,2Q^)^+'ir 

where 

*  A  7-'Qr2«I-Q.2  +  ^^7-'Q2Cf/?2QC2+5c  W 

and  is  the  Moore-Penrose  or  Drazin  generalized  inverse  of 
Q2.  Next  note  that  since  {Ae,  Be)  is  controllable  it  follows  from 
pS,  Lemma  2. 1  and  Theorem  3.6]  that  (Ae  +  BeCQi2Q2  .  ^  '^) 
is  also  controllable.  Now,  since  Q2  and  "t  are  nonnegative 
definite,  (28,  Lemma  12.2]  implies  that-Q2  is  positive  definite. 
Using  (A.  13),  similar  arguments  show  that  P2  is  positive 
definite. 

Since  R2,  V2,Q2,  P2  are  invertible,  (A.5)-(A.7)  can  be  written 
as 

-P2'Pf2Q>^Q2'=^ne.  (A.14) 

Be=  -P£'(Pl2Qi+PzQl2)C^^i'’  (A.15) 

Ceir;e+0^y-HQl2Pi+QzBl2'>Qi^Ql'^ 

=  -/?2 'B’‘(PiQi2  +  7»12C2)Q2"'-  (A.16) 
Now  define  the  tj  X  n  matrices 

Q  A  Qi-Q.2Q2"'Cr2.  P  ^  Pi-PizPi'PL’ 

Q  A  G,2Q2-'Cr2.  P  ^  PnPi'Pl2’ 

r  A  -Qi2Ql'Pl'Pj2 
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and  the  rtc  x  /i,  x  and  x  n  matrices 
G  4  Qi'Ql,.  M  i  QiPi,  r  A 
Note  that  t  =  G^T. 

Clearly,  Q,  P,  Q,  and  P  are  symmetric  and  Q  and  P  are 
nonnegative  definite.  To  show  that  Q  and  P  are  also  nonnegative 
definite,  note  that  Q  is  Ae  upper  left-hand  block  of  th? 
nonnegative  definite  matrix  where 


Similarly,  P  is  nonnegative  definite. 

Next  note  that  with  the  above  definitions  (A.  14)  is  equivalent  to 
(6.2)  and  that  (6.1)  holds.  Hence,  t  =  G^T  is  idempotent,  i.e., 

=  T.  . 

It  is  helpful  to  note  the  identities 

Q=QnG=G-^Q]^=G-^QiG,  P=  -p,zr=  -r^pr2=r’’P2r. 


(A.17) 

tG^=g^  rT=F, 

(A.18) 

^=tQ.  P=Pt, 

(A.19) 

QP=-Q,2Pl2- 

(A.20) 

Using  (A.  14)  and  Sylvester’s  inequality,  it  follows  that 

rank  G=rank  r  =  rank  Qi2=rank  Pi2=ne- 

Now  using  (A.  17)  and  Sylvester’s  inequality  yields 

nf=rank  Qi2+rank  G-/7,Srank  ^:Srank  Qi2=nf 

which  implies  that  rank  Q  =  Uc-  Similarly,  rank  P  =  He,  and 
rank  QP  =  follows  from  (A.20). 

The  components  of  Q,  and  CP  can  be  written  in  terms  of  8t  Pt 


Q,,  P,  G,  and  F  as 

Q,=e+^,Pi=P+A  (A.21) 

Q.2=^r^P,2=-PG’’,  (A.22) 

Q2=r^r^P2=G/5G^.  (A.23) 

Next  note  that  by  using  (A.21)-(A.23)  it  can  be  shown  that  the 
right-hand  coefficient  of  Q  in  (A.  16)  is  given  by 

5  A  I„^+^'-y-'-TQPC^. 

To  prove  that  5  is  invertible  use  (A.  19)  and  (6.3)  and  note  that 
A,+i5^7-'r(5PC^=/„,+^^Y-"r^’^PG’' 

=/„,-h/32r-*(r(5rO(CPGO. 

Since  and  GPG^  are  nonnegative  definite,  their  product 
has  nonnegative  eigenvalues  (see  Lemma  5.1).  Thus,  each 
eigenvalue  of  +  jS^'T^PG'"  is  real  and  is  greater  than 
unity.  Hence,  S  is  invertible.  Now  note  that  by  using  (6.2)  and 
(6.3)  it  can  be  shown  that 

G^S-'=SGL 

The  expressions  (6.11),  (6.12),  and  (6.p)  follow  from  (A.  15), 
(A.16),  and  the  definition  of  Next,  computing  cither  F(A.9)- 
(A.IO)  or  G(A.12)  +  (A.  13)  yields  (6.10).  Substituting  (A.21)- 
(A.23)  into  {A.8)-(A.13)  and  the  expression  for  Ac  into  (A.9), 
(A.  10),  (A.  12),  and  (A.  13)  it  follows  that  (A.  10)  =  F(A.9)  and 
(A.  13)  =  G(A.12).  Thus,  (A.  10)  and  (A.  13)  are  superfluous  and 
can  be  omined.  Thus,  (A.8)-(A.13)  r^uce  to 

0>cAQ+QA^+  1'i+7-^(G+&/?i-(Q+^) 
+/3^y"*(3S^PSPS^ 

■i-(/l-SPS)<5+6(/l-SPS)^  (A.24) 
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0  =  [(/4  -  SPS)  G  +  -  SPS)  QSQ 

+y-HQ^O)Ri^{Q+Q)-y-^QRx»Q 

+^^y-‘QS^PZPSQ]T^,  (A.25) 

0={A+i--[Q+Q\Ri»VP+P{.A+y-'‘lQ-i-Q]RiJ)-i-R^ 

+  (A-Qli-y-^QRt^)rp+P(^A-Qt-ry-'QR,^).  (A.26) 


0 = [(X  -  GS+7 --GP,.) '■p-i- P{/1  -  QS +7 

+S’’PSPS1G^.  (A.27) 

Next,  using  (A.24)  +  G’"r(A.25)G  -  (A.25)G  -  [(A.25)G]^ 
and  GT’(A.25)G  -  (A.25)G  -  [(A.25)G]’"  yields  (6.5)  and 
(6.7).  Similarly,  using  (A.26)  +  r^G(A.27)r  -  (A.27)r  - 
[(A.27)rj’"and  r^G(A.27)r  -  (A.27)r  -  t(A.27)r]^  yields 
(6.6)  and  (6.8). 

Finally,  to  prove  the  converse  we  use  (6.5)-(6.13)  to  obtain 
(2.14)  and  (A.4)-(A.7).  Let^„  B,.  C„  G.  T.  r.  Q.  P,  P.  €i 
be  as  in  the  statement  of  Theorem  6. 1  and  define  Q, ,  Qu,  Q>,Pi, 
Pii,  Pz  by  (A.21)-(A.23).  Using  (6.2),  (6.11),  and  (6.12)  it  is 
easy  to  v^fy  (A.6)  and  (A.7).  Finally,  substitute  the  definitions 
of  Qf  Pt  Q,  P,G,V,  and  r  into  (6.5)-(6.8)  using  (6.2),  (6.3),  and 
(A.  19)  to  obtain  (2.14)  and  (A.4).  Finally,  note  that 

which  shows  that  Q.  >  0.  □ 
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Abstract:  This  paper  considers  the  mixed-norm  Hi/H,„  standard  problem.  Specirtcally,  an  LQG  control  design  problem  involving  a 
constraint  on  disturbance  attenuation  is  addressed.  It  is  shown  that  the  H^/H^  dynamic  compensator  gains  are  compl  .tely 
characterized  via  cc  ipled  Riccati/Lyapunov  equattons.  The  principal  result  involves  sufficient  conditions  for  characterizing  full-  and 
reduced-order  controllers  that  satisfy  bounds  on  both  Hi  and  performance  costs.  As  a  special  case  of  this  unified  result  we 
obtain  the  full-order  solution  to  the  standard  control  problem  and  the  pure  reduced-order  solution  with  no  contribution. 
Further  extensions  include  nonstrictly  proper  dynamics,  a  direct-transmission  term  from  disturbances  to  performance  variables, 
cross-weighting  and  sensor  noise/plant  disturbance  correlation,  and  a  treatinent  of  the  pure  reduced-order  H,^  control  problem. 

Keywords:  design;  mixed  norm;  reduced-order  controllers. 


1.  Introduction 

In  a  recent  paper  [1]  a  unification  of  the  (LQG)  and  //^  control-design  problems  was  obtained  in 
terms  of  modified  coupled  algebraic  Riccati  equations.  Specifically,  the  results  of  [1]  address  a  unified 
solution  of  the  Hi/H^  standard  problem  for  full-  and  reduced-order  controllers.  This  mixed-norm 
problem  thus  permits  design  tradeoffs  between  performance  and  disturbance  rejection. 

The  goal  of  the  H2/H„  problem  is  to  minimize  an  H2  performance  criterion  subject  to  a  prespecified 
constraint  on  the  closed-loop  transfer  function.  The  //.,  constraint  is  embedded  within  the  optimiza¬ 
tion  process  by  replacing  the  closed-loop  covariance  Liapunov  equation  by  a  Riccati  equation  whose 
solution  leads  to  an  upper  bound  on  the  Hj  performance.  The  key  idea  to  this  approach  is  to  view  this 
upper  bound  as  an  auxiliary  cost  and,  for  a  fixed  controller  structure,  seek  compensator  gains  that 
minimize  the  H2  bound  and  guarantee  that  the  disturbance  attenuation  constraint  is  enforced.  The 
principal  result  is  a  sufficient  condition  involving  coupled  modified  Riccati  equations  whose  solutions, 
when  they  exist,  are  used  to  explicitly  construct  feedback  gains  for  characterizing  full-  and  reduced-order 
controllers  with  bounded  H2  and  //^  costs.  Note  that,  strictly  speaking,  the  problem  addressed  is 
suboptimal  in  both  the  H2  sense  and  the  sense.  However,  solving  the  design  equations  for  progres¬ 
sively  smaller  disturbance  attenuation  constraints  should,  in  the  limit,  yield  an  //^-optimal  controller 
over  the  class  of  fixed-structure  stabilizing  controllers.  Although  our  main  result  gives  sufficient  condi¬ 
tions,  these  conditions  will  also  be  necessary  as  long  as  the  mixed-norm  optimization  problem  possesses  at 
least  one  extremal  over  the  class  of  fixed-structure  controllers  (see  Lemma  2.2  and  [2]). 

*  Research  supported  in  part  by  the  Air.Force  Office  of  Scientific  Research  under  contract  F49620-89-C-0011. 
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The  solution  given  in  [1]  however,  was  restricted  to  the  case  in  which  the  plant  was  strictly  proper  and 
there  was  no  direct  transmission  from  disturbances  to  performance  variables.  The  main  contribution 
of  the  present  paper  is  to  extend  the  results  of  [1]  to  remove  these  restrictions  and  to  allow  further 
generalizations.  First,  a  direct  transmission  term  in  the  state  space  plant  dynamics  is  included  within  the 
problem  formulation  along  with  a  direct  feedthrough  term  from  exogenous  disturbances  to  perfor¬ 
mance  variables.  Next,  to  allow  for  greater  design  flexibility  we  permit  correlated  plant  and  measurement 
noise.  And,  finally,  we  consider  the  dual  design  feature  of  cross  weighting  in  both  the  H2  and 
performance  criteria.  These  generalizations  have  been  studied  in  [14]  for  full-state  feedback  and  in  [4,5,11] 
for  dynamic  compensation.  However,  the  results  of  [4,5,11]  are  lirnited  to  the  ‘pure’  full-order  standard 
problem  without  the  unification.  Furthermore,  the  results  given  in  [4,5,11]  are  obtained  by  indirect 

transformation  methods.  In  the  present  paper  we  derive  the  solution  a  to  mixed-norm  H2/H„  fixed-order 
(i.e.,  full-,  and  reduced-order)  dynamic  compensation  problem  without  employing  such  transformations. 

It  should  be  noted  that  the  approach  developed  in  [4,5]  is  quite  different  from  our  fixed-structure 
optimization  design  approach.  Specifically,  the  authors  in  [4,5]  consider  a  general  optimization 
problem  of  the  form  HT-  UQV\\„,  where  2  is  a  parameterization  of  all  stabilizing  controllers  that  give 
infinity  norm  better  than  y.  It  is  shown  that  the  central  member  of  this  set  minimizes  an  entropy 
functional  at  infinity  and  yields  a  set  of  decoupled  Riccati  equations  that  characterize  full-order  compensa¬ 
tors  satisfying  an  norm  bound  [5,8].  Furthermore,  the  results  of  [4,5,11]  are  necessary  as  well  as 
sufficient.  In  contrast,  the  approach  of  [1]  and  the  present  paper  is  based  upon  Lagrange  multiplier 
methods  which  permit  the  fixed-order-constraints  as  well  as  different  H2  and  performance  weights. 

Finally,  as  a  special  case  of  the  results  ^ven  in  the  present  paper  we  obtain  the  full-order  H2  solution 
(LQG),  reduced-order  H2  solution  [6],  full-order  solution  [3,4,5,11],  and  the  ‘pure’  reduced-order 
solution  with  no  f/j  contribution.  It  is  interesting  to  note  that  in  the  full-order  controller  case  with  no 
H2  contribution  our  results  specialize  to  [3,4,5,11].  Since  the  results  of  [3,4,5,11]  are  necessary  as  well  as 
sufficient,  these  connections  show  that  our  sufficient  conditions  (at  least  in  this  special  case)  are  also 
necessarv. 


Notation.  Note; 
R,  R",  E 
IrA  )\(  )• 

P(  ) 

S",  N',  P' 

X,  u,  y,  Xj,  X 
A,  B,  C,  D 

Ag, 

X,  A 

Y 

M 

N 

«'(•) 

Z),,  D2 
Vu  ^2,  Vu 

^Ioo>  ^co>  ^I2eo 

5,  V 

£„  £2 
£,  R2 
£(2,  R 


All  matrices  have  real  entries. 

real  numbers,  rXs  real  matrices,  expected  value. 
rXr  identity  matrix,  transpose,  complex  conjugate  transpose, 
spectral  radius. 

rXr  symmetric,  nonnegative-definite,  positive-definite  matrices. 
n,  m,  I,  n^,  n-dimensional  vectors. 
nXn,  nXm,  Ixn,  Ixm  matrices. 

X  tigXl,  mxn^  matrices. 


X 

■  A  BC,  .' 

/c. 

> 

Bf  A,  +  B,DC, 

■-^ElE„,  N^P’‘. 


positive  constant. 
q„Xd  matrix^ 

tj-y' 

cf-dimensional  standard  white  noise  or  £2  signal. 
nxd,  Ixd  matrices. 

D,Dj,  D2DJ,  DiDj;  V2GP'. 

D^N-^Dj,  D2N-'dJ,  D^N~^DJ-, 

VnBl ' 

BcV^2  B,V2BJ 
qXn,  qXm  matrices. 

[£,  £2^],  £,'^£„  EfE2:,  £2SP' 

£,■^£2,  E'^E. 


■  D,  ■ 

B,D2 

> 

=  DD^. 
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^loo’  ^2oo 
^oo>  ^top>  -^200 
^12m»  ^00 
^01»>  ^02cx5 

a, 


ft,  q„'Xfft  matrices. 

[£,„  EM,  E^^M-%^,  ELM-%„. 
El,M-%„,  ElM-^E^. 

ElM-%^,  ElM-%^.  . 
nonnegative  constants. 


2.  Statement  of  the  problem 

In  this  section  we  introduce  the  LQG  dynamic  output-feedback  control  problem  with  constrained 
disturbance  attenuation.  Without  the  ifj  performance  criterion  the  problem  considered  here  is  the 
standard  control  problem  [3,4,5].  For  simplicity,  the  first  part  of  the  paper  addresses  controllers  of 
order  =  /i  only,  i.e.,  controllers  whose  order  is  equal  to  the  dimension  of  the  plant.  This  constraint  is 
removed  in  Section  6  where  controllers  of  reduced  order  are  considered.  Hence,  throughout  Sections  2-5 
the  controller  dimension  and  closed-loop  plant  dimension  n^n  +  n^  should  be  interpreted  as  n  and 


2n,  respectively. 

i^oo-Constrained  LQG  Control  Problem.  Given  the  «th-order  stabilizable  and  detectable  plant 

x{t)  =Ax{t)  +  Bu{t)  +  Diw{t),  (2.1) 

y{t)  =  Cx{t)+Du{t)  +  D2w{t),  (2.2) 

determine  an  nth-order  dynamic  compensator 

xit)=AcX,.(t)  +  B^y{t),  (2.3) 

«(0*C^c(0.  (2-4) 

that  satisfies  the  following  design  criteria: 

(i)  the  closed-loop  system  (2.1)-(2.4)  is  asymptotically  stable,  i.e.,  A  is  asymptotically  stable; 

(ii)  the  q^^Xp  nonstrictly  proper  transfer  function 

H{s)^E„{sh-A)''D  +  E„  ■  (2.5) 

from  w{t)  to  z„{t)  =  Ei„x(t)  +  E^^u^t)  +  E„w{t)  satisfies  the  constraint 

ll^(^)ll«^Y.  '  (2.6) 

where  y  >  0  is  a  given  constant;  and 

(iii)  the  performance  functional 

J{A„  B„Q)^  +  +  (2.7) 


is  minimized. 

Note  that  the  closed-loop  system  (2.1)-(2.4)  can  be  written  as 
jc(/)  =Ax{t)  +  Dw{t) 
and  that  (2.7)  becomes 

J(A„B„CJ=  limE{[£jc(t)]'^[£x(r)]}=  lim  E[ ■c'r(r)£jc(r)] .  (2.8) 

/-•CO  '  '  /-*co 

Furthermore,  by  defining  the  transfer  function 
H(s)^E(sI,-a)~'d, 


(2.9) 


188 


H'.M.  Haddad,  D.S.  Bernstein  /  Mixed-norm  Hi/H„  standard  problem 


Fig.  1.  The  mixed-norm  standard  problem  includes  the  standard  problem  and  the  LQG  problem  as  special  cases. 


it  can  be  shown  that  when  A  is  asymptotically  stable,  (2.8)  is  given  by 

J{A,,B,,C,)=‘\\His)\\l  (2.10) 

Note  that  the  problem  statement  involves  both  H2  and  performance  weights.  In  particular,  the 
matrices  i?i  and  R2  are  the  H2  weights  for  the  state  and  control  variables.  By  introducing  the  variables 

z{t)  =  Eix{t),  v(t)  =  E2u{t),  (2.11) 

the  H2  cost  (2.7)  can  be  written  as 

J{A„  C,)  =  lim  E[z'^(r)2(t)  +  2z^{t)v{t)  +  ii'^(/)i;(f)] .  (2.12) 

For  convenience  we  thus  define  i?i  « ExEi  and  JR2  =  £^£2  which  appear  in  subsequent  expressions.  Note 
that  =  ExE2  is  an  H2  cross-weighting  term  which  is  included  for  greater  design  flexibility. 

For  ihe.f/o,  performance  constraint,  the  transfer  function  (2.5)  involves  weighting  matrices  £ioo.  £2»> 
and  £„  foj‘  the  state,  control,  and  disturbance  variables.  The  matrices  =  £,^A/“'£i„  and  £200  = 
£^A/“‘£2„  are  thus  the  counterparts  of  the  weights  £,  and  £2-  M  =  Ig^-y~^E„EZ 
arises  due  to  the  feedthrough  term  to  the  performance  variables.  Although  we  do  not  require  That  £i„ 
and  £200  be  equal  to  £j  and  £2,  we  shall  assume  for  simplicity  that  £2  =  a^Rz  and  £2*  =  where 
the  nonneg&tive  scalars  a,  ^  are  design  variables  such  that  a^  +  0.  As  in  the  H2  case  we  allow  an 

cross-weighting  term  Ri2^  Finally,  the  dual  design  feature  of  plant  disturbance  and  sensor 

noise  correlation  is  also  permitted.  As  in  [1],  w{t)  is  interpreted  as  white  noise  for  the  H2  design  aspect  and 
as  an  £2  signal  for  the  H„  desigjt  aspect.  Note  that  without  the  /f2  performance  criterion,  i.e.,  £,  =  0  and 
a  =  0,  the  problem  considered  here  reduces  to  the  ‘pure’  standard  problem  (see  Figure  1). 

Before  continuing,  it  is  useful  to  note  that  if  A  is  asymptotically  stable  for  a  given  compensator  {A^,  B^, 
Q)  then  the  H2  performance  (2.8)  is  given  by 

J{A„  B„C,)  =  tTQR,  (2.13) 

where  the  steady-state  closed-loop  state  cpvariance  defined  by 

Urn  E[x(/)xT(/)]  (2.14) 

/-*00 

satisfies  the  «  X  n  algebraic  Lyapunov  equation 

0  =  AQ+  Q.P  +  V.  (2.15) 

The  key  step  in  enforcing  the  disturbance  attenuation  constraint  (2.6)  is  to  replace  the  algebraic 
Lyapunov  equation  (2.15)  by  an  algebraic  Riccati  equati,c.n  that  overbounds  the  closed-loop  steady-state 
covariance.  Justification  for  this  technique  is  prorided  by  the  following  result. 
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Lemma  2.1.  Let  (A^,  Q)  be  given  and  assume  there  exists  satisfying 

and 

0=A£  +  y~^(£>E^  +aEl)M-\bEl  ^SlE^y  +  V. 

Then 

(A,  b)is stabilizable 
if  and  only  if 

A  is  asymptotically  stable. 

In  this  case, 

\\H{s)\\^^y 

and 

Consequently, 

J{A„  B,,  C,)  ^/{A,,  B,,  Q,  ^), 
where 

jf(A„  B„C„  £)^tr^R. 

Proof.  It  follows  from  (13,  Theorem  3.6]  that  (2.18)  implies  that 

(/f,  ly-^(bEj+£E^)M-^^(bE„+£Ej^f  + 

is  also  stabilizable.  Using  the  assumed  existence  of  a  nonnegative-definite  solution  to  (2.17)'  and  [13, 
Lemma  12.2]  it  now  follows  that  .4' is  asymptotically  stable.  The  converse  is  immediate.  To  prove  (2.20), 
replace  V  by  bb'^  and  add  and  subtract  jal^£  to  (2.17)  so  that  (2.17)  becomes 

0  =  (-j<oI,  +  A)£  +£(i<oI,  +  ^'^  +  y-^bEj  ■i-£E^)M-^(bEZ  +^Elf  +  bb'^  (2.24) 

or,  equivalently, 

bb"^  =  (j<o4  -A)£+£{  - j«/,  -  if  -  y-" ( bEl  +  2EZ)  M- '  (  +  £eZ  f.  (2.25) 

Next,  forming 

£„(jco7,  -  i)"'(2.25)(  -j<o/,  -  Ay'^EZ 
yields 

.  E„{ioI,  -  Ay'bb-^i -jtol,  -  A)  ~'"eZ 

=  E^ijtal,  -  Ay'£EZ  +  E„£{-icoI„-Ay'^EZ 

'-y-^E„{i<^h-A)~'[{bEZ+£EZ)M-^{bEZ+£EZYl{-}caI,-A)^EZ. 
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(2.16) 

(2.17) 

(2.18) 

(2.19) 

(2.20) 
(2.21) 
(2.22) 
(2.23) 


(2.26) 
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Now  adding  -  A)  -  A)~'^  +  to  both  sides  of  (2.26)  yields 

E„[)osh  - -j«/,  -  A) ~'"eI  +  -  A)~'bEl 

+E^D^[-lt,I,-A)~’"El  +  E^El 

=  E^{iosI,-Ay\bEl+£lEl]  +  [bEl+^ElY[~losI,-I)-'"  +  E„El 

+  (2.27) 

Note  that  the  left  hand  side  of  (2.27)  is  equal  /f(jw)/f*(jw)  and  the  right  hand  side  of  (2.27)  can  be 
written  as 

£  +  £*-Y-^SA/-*S*  +  y^{/,„-A/)  (2.28) 

where 

S  ^  £«,(jc./,  -  A)~\bEl  +£LEl] 

and  £«,£^  is  replaced  by  -  Af).  Hence,  it  follows  from  (2.27)  and  (2.28)  that 

if(j<o)i/*0'«)  =  -[(YA^‘^-V"*5A/*/^)(YAf*/^-Y-’£A/'/^)*]  +Y%„^0,  (2.29) 

which  implies  i7(jw)//’*(j<o)^  Y%„-  This  proves  (2.20).  To  prove  (2.21),  subtract  (2.15)  from  (2.17)  to 
obtain 

Q^A{£l-Q)-^{^-Q)A'^-^y-\bElA-ml)M-\bEl+BEiy  (2.30) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

M-Q^  j\^\y-\bEl  +^El)M-\bEl  +SlElf]  dr k 0. 

Finally,  (122)  follows  immediately  from  (2.21).  O 
Remark  2.1.  An  equivalent  form  of  (2.17)  is  given  by 

0  =  (/!+  y-^bElM-'^E„)a+£l{A  +  y-^bElM-'^E^y.  +  y-^2ElM-'^E„£t  +  (2.31) 

The  equivalence  of  (2.17)  and  (2.31)  is  easily  shown  by  noting  that  (2.17)  can  be  rewritten  as 

0  =  (i+  y-^bElM-%)Sl+2{A  +  y-'^bElM-^E„f 

+  y-^SlElM-^E^2  +  y-^bElM-^E^b'^  +  bb'^  (2.32) 

and  noting  that  b[y~^E2iM~^E^  +  is  equal  to  bN~^b^  since  E^M~^  =  Ar“‘£j  and 

iV-‘(Y-'£;^£„  +  iV)  =  iV-'. 

Lemma  2.1  shows  that  H„  disturbance  attenuation  is  automatically  enforced  when  a  noimegative-defi- 
nite  solution  to  (2.17)  is  known  to  exist  and  A  is  asymptotically  stable.  Furthermore,  all  such  solutions 
provide  upper  bounds  for  the  actual  closed-loop  state  covariance  Q  along  with  a  bound  on  the  H2 
performance  criterion.  Next,  we  present  a  partial  converse  of  Lemma  2.1  that  guarantees  the  existence  of  a 
unique  minimal  nonnegative-defmite  solution  to  (2.17)  when  (2.20)  is  satisfied.  The  minimal  solution  is 
desirable  since  it  yields  the  tightest  performance  bound  in  (2.22).  This  was  first  pointed  out  in  [7]. 

Lemma  2.2.  Let  (A,.,  Q)  be  giuen,  suppose  A  is  asymptotically  stable,  and  assume  the  disturbance 
attenuation  constraint  {2.20). is  satisfied.  Then  there  exists  a  unique  nonnegative-definite  solution  2.  satisfying 
(2.17)  and  such  that  the  eigenvalues  of  A  +  y~'^bEf,M~'^E„  +  y~'^2E2,M~^E„  lie  in  the  closed  left  half 
plane.  Furthermore,  this  solution  is  also  minimal. 
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Proof.  The  result  is  an  immediate  extension  of  [2,  pp.  150  and  '.67],  using  Theorems  3  and  2.  The  proof  of 
minimality  of  given  in  [12].  □ 


3.  The  Auxiliary  Minimiz.ation  Problem 

As  shown  in  the  previous  section,  replacing  (2.15)  by  (2.17)  enforces  the  disturbance  attenuation 
constraint  and  yields  an  upper  bound  for  the  /fj  performance  criterion.  ITiat  is,  given  a  compensator 
(A^,  Be,  Q)  for  which  there  exists  a  nonnegative-definite  solution  to  (2.17),  the  actual  Hj  performance 
J{Ae,  Be,  Ce)  of  the  compensator  is  guaranteed  to  be  no  worse  than  the  bound  given  by  ^^(^4^,  Be,  Q,  .2). 
Hence,  /{  Ae,  Be,  Q,  .2)  can  be  interpreted  as  an  auxiliary  cost  which  leads  to  the  following  optimization 
problem. 

Auxiliary  Minimization  Proble.-n.  Determine  (^4^,  Be,  Q,  .2)  which  minimizes  Jf{,Ae,  Be,  Q,  .2)  subject  to 

(2.17)  with  .2  , 

It  follows  from  Lemma  2.1  tliat  the  satisfaction  of  (2.16)  and  (2.17)  along  with  the  generic  condition 

(2.18)  lead  to:  (1)  closed-loop  stability;  (2)  prespecified  performance  attenuation;  (3)  an  upper  bound 
for  the  H2  performance  criterion.  Hence,  it  remains  to  determine  (/f^.  Be,  Q,  £)  that  minimizes 
./{Ae,  Be,  Ce,  ^),  and  thus  provides  an  optimized  bound  for  the  actual  H2  performance  /(^c  Be,  Ce). 


4.  Sufficient  conditions  for  disturbance  attenuation 


In  this  section  we  state  sufficient  conditions  for  characterizing  full-order  controllers  guaranteeing 
closed-loop  stability,  constrained  disturbance  attenuation,  and  an  optimized  H2  performance  bound. 
For  arbitrary -2,  P,  2  s  and  a,  )3  s  0  define  the  notation 

QC^  +  PcHB'^  +  y~^Rl2^Dj  +  y-^Rj2„{Q  +  Q)]P  +  Rn, 

S^{a%  +  P^y-^QPy' 
when  the  indicated  inverse  exists. 


Theorem  4.1.  Suppose  there  exist  Q,  P,  N"  satisfying 

0  =  (/I  +  v-^D,i?oi=o)C  +  Q{A  +  -  QaK2Ql,  (4.1) 

0  =  {A+y-^[Q  +  Q]  Rr„  +  y-^D^R^^„  -  y-^QS’^PjRyRj2„)' P 

+  P(/l  +  [2  +  e]  +  Y"'X)iAo,„ -  y-^QS'^PjRyRl2«)  +  /?,  -  S^PjRyPe,S.  (4.2) 

0  =  (^  -  BR^PeS  +  y-^Q[R,„  - +  y-^[i),Poi=o  " D,Ro2„RVPaS])Q 

+  Q{A  -  BR^P^S  +  y-^2[f?,co  -  Rn^oRVPaS]  +  “  A^02=o^2 

+  y'^Q{Ri«  -  Rn^Rz%S  -  S'^PjRyR{2„  +  P^S'^PjRyP,S)Q+  Q,V2-^QI  (4.3) 

and  let  (.4,,  P,.,  Q,  .2)  be  given  by 

Ae  =  A-BR2  'P,S  -  Q„yTjC  -  Q,V2-e^DR2  'KS 

+  y  ^(2Pio5  4"'  BiRoieo  —  DiRQ2oi,R2  'P —  ^R\2(oR2 

-2«n»A^0I«  +  QaVf^D2R^2j.VPaS), 


(4.4) 
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C,=  -RVPaS, 


2  = 


Q  +  Q 
Q 


Q 

Q 


(4,5),  (4,6) 


(4.7) 


Then  {A,  D)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  case,  the  closed-loop  transfer 
function  H(s)  satisfies  the  disturbance  attenuation  constraint  (2.20)  and  the  performance  criterion 
(2.7)  satisfies  the  bound 


J(A„  B„  Q)  ^  tr[(2  +  2)i?,  -  IRnRVPaSQ  +  S'^PJR^^R^RVPoSQ]  - 


(4.8) 


Proof.  The  proof  follows  as  in  the  proof  given  in  [1].  □ 


Remark  4.1.  Theorem  4.1  presents  sufficient  conditions  for  designing  controllers  with  a  prespecified 
constraint  on  the  closed-loop  transfer  function.  These  sufficient  conditions  comprise  a  system  of  three 
modified  algebraic  Riccati  equations  in  variables  Q,  P,  and  Q.  The  Q  and  P  equations  are  similar  to  the 
estimator  and  regulator  Riccati  equations  of  LQG  theory,  while  the  Q  equation  has  no  counterpart  in  the 
standard  Aeqry.  Note  that  the  Q  equation  is  decoupled  from  the  P  and  Q  equations  and  thus  can  be 
solved  independently.  The  ?  equation,  however  depends  on  Q.  Thus,  regulator/estimator  separation  holds 
in  only  one  direction  which  clearly  shows  that  the  certainty  equivalence  principle  is  no  longer  valid  for  the 
mbced  H^/H^  design  problem.  Finally,  note  that  if  the  74,  disturbance  attenuation  constraint  is 
sufficiently  relaxed,  i.e.,  y  -*  oo,  then  the  P  equation  becomes  decoupled  from  the  Q  equation  and  thus  the 
Q  equation  becomes  superfluous.  Furthermore,  the  remaining  Q  and  P  equations  separate  and  coincide 
with  the  standard  LQG  result.  Alternatively,  note  that  if  both  fi  =  0  and  =  0,  then  Theorem  4.1  also 
specializes  to  the  standard  LQG  result. 

Remaric  4.2.  The. results  of  [1]  are  a  special  case  of  Theorem  4.1.  To  see  this  set  the  plant/measurement 
noise  correlation  to  zero  (1^,2  =  0),  set  both  the  /fj  and  cross  weighting  terms  to  zero  (R12,  R.noo  ~  0), 
set  the  direct  transmission  term  in  the  plant  dynamics  to  zero  (0  =  0)  and  set  the  feedthrough  term  from 
disturbances  to  H„  performance  variables  to  zero  (E„  =  0).  This  yields  Theorem  3.1  of  [1]. 

Remark  43.  When  solving  (4.1)-(4.3)  numerically,  the  H„  constraint  can  be  adjusted  to  examine  tradeoffs 
between  performance  and  disturbance  rejection.  Specifically,  y  can  be  varied  systematically  to 
determine  the  region  of  solvability  of  the  design  equations  (4.1)-(4.3)  and  to  study  tradeoffs  between  the 
74/^00  performance  criteria  (see  [1]). 


5.  The  pure  standard  problem 

As  shown  in  Theorem  4.1,  the  Riccati  equations  (4.1)-(4.3)  provide  sufficient  conditions  for  explicitly 
synthesizing  controllers  (A^,  Cf)  satisfying  both  and  H„  performance  bounds.  The  main  purpose 
of' this  section  is  to  completely  eliminate  the  aspect  in  the  design  problem.  This  section  also  provides 
connections  between  our  approach  and  the  recent  results  obtained  in  [3,4,6].  In  [1]  it  was  shown  that  by 
equalizing  the  weights  the  three  coupled  Riccati  equation  form  could  be  transformed  into  two 

decoupled  Riccati  equations  as  in  [3,7].  Furthermore,  it  was  shown  in  [7]  that  the  aux’liary  cost  (2.23)  is 
equivalent  to  an  entropy  integral.  However,  it  is  important  to  note  that,  as  noticed  in  Remark  2.1,  the 
resultsrof  [7]  cannot  consider  a  general  direct  transmission  term  from  disturbances  to  performance 
variables  in  order  to  guarantee  that  the  minimum  value  of  the  entropy  evaluated  at  infinity  is  finite.  In  the 
present  paper  we  utilize  a  simpler  approach  wherein  we  eliminate  the  contribution  by  letting  R12,  a 
(and  thus  Rf)  approach  zero.  By  eliminating  the  contribution  to  the  problem,  the  resulting  setting 
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corresponds  to  the  standard  problem.  In  order  to  state  the  main  result  we  .require  some  additional 
•notation.  For  arbitrary  5^  e  define  the  notation 

^  +  r^Rl2„Dj . 

Theorem  5.1.  Suppose  there  exist  Q  e  and  S  P"  satisfying 

0  =  (^  +  y-^A^oi«)!2  +  Q{A  +  +  y-^QRi„Q  -  QaK^Ql  (5:1) 

0  =  {A  +  y-^D,Ro,„yY„  +  Y„{a  +y-^D,Ro,^)  +  +  Y-^y„y,„y„  -  Y^.R^^Y^,,  (5.2) 

P(QYj<y\  (5.3) 

and  let  (A^,  Q)  be  given  by 

A,  =  A  -  BRI^Y^,{I„  - y-^QY^)'^  -  .+  G,f7Jl>^2coi;,.(-f.  “  r^QYj)~' 

+  Y"'[2i?,oc  +  A^Olcc  -  Ai?02oo^ril'«a(4  "  y'^QY^Y' 

-QKn^RZ«Y^a{in~y-^QY„Y'  -  e<.17«l>2^01oo 

+  e^i7co‘A^02«.-R2“iy«.(/„ -y-^QYY)~'] .  (5.4) 

5.=  G.IT«'.  C,=  -R2lY^,{l„-y-'^QY^Y\  (5.5),  (5.6) 

Then  (A,  D)  is  stabilizable  If  and  orily  if  A  is  asymptotically  stable.  In  this  case,  the  closed-loop  transfer 
function  H(s)  satisfies  the  disturbance  attenuation  constraint  (2:20). 

Proof.  First  let  i?,,  i?,2,  a-»0  m  equations  (4.1)-(4.3)  so  that  S  P~^y^P~^Q~^.  Next,  note  that 
PgS  =  li~^y^SQ~^,  where 

.r  4  pT  +  y-2RT  ^£,T  +  y-iRl^{Q  +  g). 

Now  define  “  7^G~*  and  substitute  i“to  (4.3)  to  obtain 

0  =  (yl  +  y-^QRi„  +  ^Z„{A  +  y-^QR,„  +  /{.,„)  +  i?,„ 

where  Z„a  =  ZZ„.  Now  note  tb.V  (5.2)  follows  by  forming  Y„  =  (Z"'  +  y^G)“’.  The  gain  expressions 
(5.4)-(5.6)  follow  as  a  direct  consequence.  □ 

Remark  5.1.  The  solutions  Q  and  Y„  of  (5.1)  and  (5.2)  are  analogous  to  the  matrices  S  and  P  of  [5]  and  5^ 
and  X„  of  [4],  while  (5.3)  corresponds  to  condition  5.2  (iii)  of  [4]. ' 

Remark  5.2.  By  setting  Run,  and  D  to  zero,  the  results  of  Theorem  5.1  specialize  to  Theorem  6  of  [3] 
and  Proposition  5.7  of  [1]  without  the  H2  performance  bound. 


6.  Mixed-norm  reduced-order  dynamic  compensation 

In  this  section  we  extend  Theorem  4.1  by  expanding  the  formulation  of  Sections  2  and  3  to  allow  the 
compensator  to  be  of  fixed  dimension  n^  which  may  be  less  than  the  plant  order  n.  Hence,  in  this  section 
define  h-n  ir  n^,  where  ^  n.  As  in  [1,6]  this  additional  constraint  leads  to  an  oblique  projection  that 
introduces  additional  coupling  in  the  design  equations  along  with  an  additional  equation.  The  following 
lemma  is  required  for  the  statement  of  the  main  theorem  (see  [1].) 
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Lemma  6.1.  Let  Q,  P  e  N"  and  suppose  rank  QP  =  n^.  Then  there  exist  n^Xn  G,  F,  and  X  n^  invertible 
M,  unique  except  for  a  change  of  basis  in  IR''%  such  that 


(6.1),  (6.2) 

(6.3),  (6.4) 


QP^G’^MF,  FG'^  =  I„^. 

Furthermore,  the  nXn  matrices 
T  =  G’^r,  Tjl  =  /„  -  T 
are  idempotent  and  have  rank  n^  and  n  —  n^. 

Theorem  6.1.  Let  n^^n,  suppose  there  exist  Q,  P,  g,  P  e  N"  satisfying 

0  =  (^  +  y-^DiRoi„)Q  +  QiA  +  Y-^Z),Poi«>r  +  y~-QRioeQ 
+  ^^loo  -  QaFfjQl  +  rfQ.K^QlTl . 

0  =  (^  +  y-^[Q+  q]  +  y-%Roi„  -  y-^QS'^PlR2^Rj2«y P 

+  P{A  +  y-^[Q  +  q\  +  y-^DiPoi^  “  y-'gS'^P.Pj’P^zco) 

+  Pi  -  S'^PjRZ^S  +  tIS'^PJPJ'P.Stj.  , 

0  =  (^  - PPJ'P^S  +  y-2g[P,„ - Rnc^Ri^PaS]  +  y-'A[^oico  " 

+  q{A  -  BR2%S  +  y-'g[Pi„  -  Pi2„Pr»P,s]  +y-"i),[Poi»  - Ro2c.RVR-aS]y 
+  y-^Q{Rioo  -  RnooRVPaS  -  S'^PjR^^Rj2^  +  $^S'^pJR2%S)Q 
+  SafTJ<2J-rj.e,^jQjrJ, 

0^(A-  Q^fTJc + y-^APoioo  +  y-^QRic  -  r'^QafTJ^zRoicofp 
+  P(A~  + y-2z)iPoi„  +  y-^QRioo  -  y~^QaV2-jD2Ro^„) 

+  s'^pJr2%s  -  TlpTpJpj  >P,St^  , 
rank  Q  =  rank  P  =  rank  QP  =  n^, 
and  let  (A^,  Q,  .2)  be  given  by 

-  A,  =  fIa  -  BR^PaS-  QafTJC  +  g„PrJ^PJ>P„5  +  y-^(eP,„  +  2?,Poi=o 

-I>lR02^Rl'PaS-QRi2«>Rl'PaS-Q.krjD2R0lcc  +  Qa^2-J^2Ro2coRl'PaS)]G\ 


(6.5) 


(6,6) 


(6.7) 


(6.8) 

(6.9) 


Rc  =  PQafTJ,  Q  =  -R2^P,SG\ 
Q  +  Q  Qr^' 

FQ  FQF'^ 


(6.10) 
(6.11),  (6.12) 

(6.13) 


Then  (A,  D)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  case,  the  closed-loop  transfer 
function  H(s)  satisfies  the  disturbance  attenuation  constraint  (2.20)  and  the  Hi  performance  criterion 
(2.7)  satisfies  the  bound 


J{A„  B„  Q)  ^  tr[(Q  +  Q)P,  -  IR^^Rl^P^SQ  +  S’^PjPr'P.Sg] . 


(6.14)  ■ 


Proof.  The  proof  follows  as  in  [1]  with  the  additional  terms  arising  due  to  cross  weighting, 
disturbance/measurement  noise  correlation,  and  direct  feedthrough  terms.  □ 


W.M.  Haddad,  D.S.  Bernstein  /  Mixed-norm  H2/H„  standard  problem 


195 


Remark  6.1.  It  is  easy  to  see  that  Theorem  6.1  is  a  direct  generalization  of  Theorem  4.1.  To  recover 
Theorem  4.1,  set  n  ^  «  so  that  t  =  C?  =  F  =  /„  and  =  0.  In  this  case  the  last  term  in  each  of  (6.5)-(6.8) 
can  be  deleted  and  (6;8)  becomes  superfluous.  Furthermore,  (6.5)-(6.7)  now  reduce  to  (4.1)-(4.3),  as 
expected.  Alternatively,  setting  y  =  oo  and  retaining  the  reduced-order  constraint  yields  the  result 

of  [6].  Finally,  to  recover  Theorem  6.1  of  [1]  set  Fjj  =  0,  R,2  =  0,  Ri2„  ~  0,  D  —  0,  and  E„  =  0. 

Remark  6.2.  As  was  noted  earlier,  the  assumption  that  R2  =  c^R2  and  R^^  =  mads  for 

simplicity.  If  it  is  desired  that  Rj  -^Zco  bs  independent  then  (6.12)  is  given  by 

Q=  -vec“'[f2vec(PaG'^)], 

where 

^^R2®I„+r^R2os®J^QPG^, 

‘vec’  is  the  column  stacking  operation,  and  ®  denotes  Kronecker  product.  In  this  case,  the  cprapensator 
dynamics  (6.10)  along  with  the  design  equations  (6.5)-(6.8)  have  to  be  changed  accordingly.  However,  due 
to  lack  of  space  this  result  is  not  given.  Similar  remarks  apply  to  the  full-order  mixed-norm  problem  given 
by  Theorem  4.1. 


7.  The  pure  reduced-order  dynamic  compensation  problem 

In  this  section  we  eliminate  the  H2  aspect  of  the  reduced-order  design  problem  to  obtain  reduced-order 
controllers  for  Ae  pure  standard  problem.  As  in  the  full-order  controller  case  (Section  5)  we  elinunate 
the  H2  contribution  by  letting  Rj,  R12,  a  (and  thus  R2)  approach  zero.Th  ordento  state  the  main  result  we 


require  some  additional  notation.  For-rarbitrary  (2,  Q,  R  e  IV",  and  G,  Fs  define 

R,„^RTR  +  y-2R^i„i)7'?-»-Y-2RT2«,(e  +  C)R,  (7-1) 

M„^(FQF^)"\  N„^{GPG^)~\  ’  (7.2),  (7.3) 

W„  =  Y^F-^SjGRj^Ria-R^^GXr.  (7.4).  (7.5) 

Theorem  7.1.  Suppose  there  exist  Q,  P,  Q,  Pe.  N"  satisfying  (6.9),  GPG^  >  0,  and 

0  =  (^  +  y“'A^oi«)!2  +  2(^  +  y"'x>,Ro,„r 

+  +  y-^QR,„Q  -  QafTjQl  +  QaKMrl .  (7-6) 

0  =  (^  +  y-^[Q  +  Q]  Ri„  +  y""ARoi»  -  y-^QrsZGPj„R2XRl2^  +  r^QwJp 
+  P{A  +  y-^[Q  +  2]  R,„  +  y-^ARoioo  -  Y~ 

R,„  -P,„R2^P,^  +  (/„  -  GX^f  (7-7) 


0  =  (^  - RRriR„„GXr  + -3?i2»i?2'ciR«»GXr^ 

+y-M  AT^Oloo  -  Ro2»/?:iRac»<?Xr])2 
+  Q{A  -  RR3-^R,„GXr  +  y-"2[Ri„  -  R,2„R2URa»GXr]; 

+y-^[D,R.,^  -  Ro2„/?7iR„„CXr]) 

+  Y“"e(R,„  -  Rucc-R2‘ciR.«oGXl’-  FX7’Jco^2'<i^T2cc  +  W„)Q 
+  (2«fr«el-Tx!2.^7J2lTi, 


(7.8) 
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0  =  (/t  -  + y-^A^oico  +  y-^QRx^  -  Y"UH->2^b.co)’"^ 

+  P[A-  (2,fTjC + y-'A^oico  +  -  Y"'<2.fT>2«oi«=) 

+  PLRilPa^  -  (4  -  <fS„rfpJ^R2^P,„{l„  -  cXr)  -  y-^{lK,QP  +  PQW„),  (7.9) 

and  let  (A^,  B^,  C,)  be  given  by 

A,=t'[A  -  Qj^jG+ 

+y~^{QRi<. + A^oio,  -  A^02«i?r«AcoC?'"5„r  -  !2^,2„«riA»G’^5„r 

-  e.fr»*A>Roi^  +  eafTjA*'io2«^2«  A«GXr)]  (?4  (7.10) 

Bc  =  rQ,VrJ.  (7.11),  (7.12) 

77ie«  (y4,  jD)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  case,  the  closed-loop  transfer 
function  H{s)  satisfies  the  Ha,  disturbance  attenuation  constraint  (2.20). 


Proof.  The  proof  follows  from  Theorem  6.1  by  using  the  relation  G^Sr  =  Sr,  where  5  =  (aV„^  + 
y~^P^rQPG^)~^  and  letting  R^,  R12,  a  -♦  0.  □ 

Remark  7.1.  Theorem  7.1  presents  sufficient  conditions  for  designing  reduced-order  controllers  with  a 
prespcdfied  constraint  on  the  closed-loop  transfer  function  with  no  H^  contribution.  Thus,  Theorem 
7.1  addresses  the  pure  reduced-order  //^-standard  problem.  Note  that  considerable  simplification  can  be 
achieved  in  the  design  equations  by  setting  R1200.  Ao*  to  zoto. 


8.  Numerical  solution  of  the  design  equations 

Although  the  design  equations  appearing  in  Theorems  4.1,  6.1  and  7.1  appear  formidable,  they  are,  in 
fact,  quite  numerically  tractable.  One.  of  the  principal  motivations  of  the  Riccati' equation  approach  to  the 
mixed  norm  problem  is  the  opportunity  it  provides  for  developing  efficient  computational  algorithms  for 
control  design.  In  particular,  the  goal  is  to  develop  numerical  methods  that  exploit  the  structure  of  these 
modified  Riccati  equations.  It  should  be  noted,  however,  that  existing  methods  for  solving  standard 
Riccali  equations  caimot  account  for  the  additional  terms  that  appear  in  the  modified  equations  such  as 
(6.5)-(6.8).  Therefore,  a  new  class  of  numerical  algorithms  has  been  developed  based  upon  homotopic 
continuation  methods.  These  methods  operate  by  first  replacing  the  original  problem  by  a  simpler  pr-.iblem 
with  a  known  solution.  The  desired  solution  is  then  reached  by  inte^ating  along  a  path  (homotopv  path) 
that  connects  the  starring  problem  to  the  original  problem.  The  advantage  of  such  ^gorithms  is  ^at  they 
are  based  on  theories  which  are  global  in  nature.  In  particular,  homotopy  methods  facilitate  the  firiding  of 
(multiple)  solutions  to  a  problem,  and  the  convergence  of  the  homotopy  algorithms  is  generally  not 
dependent  upon  having  initial  conditions  which  are  in  some  sense  close  to  the  actual  solution.  These  ideas 
have  been  illustrated  for  the  H2  reduced-order  problem  in  [9]  and  the  H„  constrained  problem  in  (1)  where 
the  additional  coupling  terms  preclude  standard  solution  techniques.  A  complete  description  of  the 
homotopy  algorithm  is  given  in  [10]. 
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Abstract;  Recent  papers  have  considered  the  problem  of  minimizing  an  entropy  functional  subject  to  an  Hy,  performance  constraint. 
Since  the  entropy  is  an  upper  bound  for  the  /fj  cost,  there  remains  a  gap  between  entropy  mimmiz.:tion  and  Hi  minimization.  In 
tliis  paper  we  consider  a  generalized  cost  functional  involving  both  Hi  and  entropy  aspects.  This  approach  thus  provides  a  means  for 
optimizing  Hi  performance  within  control  design. 

Keywords:  Hi  design;  minimum  entropy;  mixed-norm  Hi/Hyy  design. 


1.  Introduction 

It  was  recently  shown  in  (1]  that  suboptimal  controllers  can  be  characterized  by  means  of  modified 
Riccati  equations.  These  equations  were  obtained  by  minimizing  an  Hi  performance  bound  subject  to  a 
constraint  on  the  performance.  Subsequently  it  was  shown  that,  in  the  equalized  weight  case, 

the  Hi  performance  bound  coincides  with  an  entropy  functional  [4,5].  Although  less  familiar  than  the  Hi 
objective,  the  entropy  functional  is  mathematically  tractable  within  the  context  of  H„  control  theory. 

In  many  practical  applications,  however,  it  may  be  desirable  to  minimize  the  Hi  cost  directly.  That  is, 
although  the  entropy  functional  bounds  the  Hi  cost  (in  the  equalized  weight  case),  there  may  exist  a  ‘gap’ 
between  these  performance  measures.  Thus,  the  control  law  that  minimizes  the  entropy  need  not  also 
minimize  the  Hi  performance. 

The  goal  of  the  present  paper  is  to  extend  the  approach  of  [1]  to  include  both  Hi  and  entropy 
performance  measures  within  the  context  of  constrained  H^  design.  This  multiobjective  problem  is  treated 
by  forming  a  convex  combination  of  both  performance  measures.  This  approach  is  reminiscent  of 
scalarization  techniques  for  Pareto  optimization  [4]. 

For  simplicity  the  present  paper  is  confined  to  static  full-state  feedback  control.  Full-  and  reduced-order 
dynamic  compensation  as  in  [1]  will  be  considered  in  a  future  paper. 

Notation.  Note:  All  matrices  have  real  entries. 

R,  R'■^^  R'"  real  numbers,  rXs  real  matrices,  R'"’^*. 

/„  (  )\  tr  .rXr  identity  matrix,  transpose,  trace. 
n,  m,  d,  q,  q„  positivf  integers. 

X,  u  n,  m-dimensional  vectors. 

A,  B,  K  nX  n,n  Xm,  mXn  matrices. 

M'(-)  Li  disturbance  signal. in  R‘'. 

•  This  research  wa.s  supported  in  part  by  the  Air  Force  Office  of  Scientific  Research  under  contract  F49620-89-C-0011. 
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,V  nXd,  nXn  matrices;  V  =  DD^. 

i,  E2  9  X  n,  9  X  ffj  matrices;  £i’£2  =  0. 

i,  £2  -  E^Ei,  EJE^. 

i?i  +  K'^R^K. 

i«.  -^zco  <looXn,  q„Xm  matrices;  E^^E^^  =  0. 

lao>  -^Zoo  -^iw^Ioo*  ^loo^Zao’ 

„  R.^  +  K'^R^^K. 

a,  P;  y  real  numbers;  positive  number. 


2.  Problem  statement 


Combined  H2/H„ /Entropy  Control  Problem.  Consider  the  nth-order  dynamic  system 
x{t)  =Ax{t)  +  Bu{t)  +  Dw{t),  rs[0,  00), 
with  feedback  law 
u{t)=‘Kxit), 

and  H2  and  performance  variables 
Z2it)  =  E^x(t)  +  E2u(t), 

^=e(0  =  -^l«^(0+-E’2««(0- 

Then  determine  KsU"'^"  satisfying  the  following  design  criteria: 

(i)  the  closed-loop  system  (2.1),  (2.2)  is  asymptotically  stable,  ile.,  A^A  +  BK  is  Hurwitz; 

(ii)  for  given  y  >  0,  the  q„  x  d  transfer  function 

GM^iE,^+E2^K){sI„-A)''D 

from  disturbances  w(‘)  to  performance  variables  satisfies  the  /fj^-norm  constraint 

II  II 00  <  "y: 

(iii)  for  /i  €  [0, 1]  the  cost  functional 

y(£)^/t||G2iii  +  (i-M)/(G»,Y) 

is  minimized,  where 

G2is)^iE,  +  E2K){sJ„-A)''D 

is  the  ^  X  d  transfer  function  from  disturbances  w  to  H2  performance  variables  Z2. 

2  *  2 

/(G„,Y)^-lim  ^rin|det(/„-y-'2G„0«)G*M)|  dco 

fo-eo  [zir  '  So +  ur\ 

is  the  entropy  functional  for  the  performance  variables  z„. 


(2.1) 

(2.2) 

(2.3) 

(2.4) 

(2.5) 

(2.6) 
(2.7) 
(2^8) 

(2.9) 


Note  that  the  problem  statement  involves  both  H2  and  performance  variables  where  for  generality 
Z2  is  not  necessarily  equal  to  r,,,-  For  convenience  we  omit  H2  and  cross  weighting  terms  by  assuming 
E'^E2  =  0  and  £j’^£'2oo  =  0. 

As  discussed  in  [5,6],  the  entropy  functional  (2.9)  can  be  viewed  as  a  measure  of  the  distance  from 
ll<7„||«,  to  y.  Like  the  £^2  norm,  but  unlike  the  norm,  however,  the  entropy  /(G^,  y)  accounts  for 
G^O'to)  at  all  frequencies.  Furthermore,  it  can  be  shown  [2]  that  the  entropy  functional  at  infinity  is 
equivalent  to  the  exponential-of-quadratic  cost  of  the  Risk-Sensitive  LQG  Control  Problem  [8]. 
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Remark  2.1.  Note  that  (2.7)  involves  a  convex  combination  of  two  scalar  costs.  By  varying  ^  e  [0, 1],  (2.7) 
can  be  viewed  as  the  scalar  representation  of  a  multiobjective  cost  (see,  e.g.,  [4]).  By  setting  fi  =  Owe  obtain 
an  entropy//foo  control  problem  as  in  [1].  However,  it  is  important  to  stress  that  if  ft  =  1  then  the  entropy 
functional  is  excluded  from  the  cost  functional  (2.7)  so  that  the  optimization  procedure  is  unable  to 
enforce  (2.9).  In  this  case  the  bound  (2.6)  plays  no  role  and  the  standard  H2  LQR  problem  is  obtained. 
The  practical  value  of  this  formulation  is  the  case  ft. » 1  in  which  the  role  of  the  entropy  functional  (2.9)  is 
deemphasized  and  the  optimization  problem  corresponds  to  minimizing  the  octwa/  i/2  cost  while  enforcing 
the  constraint  (2.6). 


3.  Reformulation  of  the  control  problem 

In  this  section  we  reformulate  the  combined  H2/H„/Erii'[o^y  Control  Problem  to  facilitate  the 
development  of  optimality  conditions.  First,  we  present  a  sufficient  condition  that  enforces  the  disturbance 
attenuation  constraint  (2.6).  For  arbitrary  ATe  define  the  notation 

r'^R^  +  K'^K^K,  R„^R,^  +  K'^R2^k,  V^DD'^, 

Lemma  3.1.  Let  be  given  and  assume  there  exists  a  nonnegative-definite  matrix  .2eR"^" 


satisfying 

0  =  A^+£lA^  +  y-'^£lR„Sl->rV.  (3.1) 

Then 

(A,  D)  is  stabilizable  (3i2) 

if  and  only  if 

A  is  Hurwitz.  (3.3) 

In  this  case,  the  following  statements  hold: 

(i)  the  transfer  function  satisfies 

ll<?ccll»^r,  (3.4) 

(»)  if 

/(G„,Y)^tr^R„;  (3.5) 

(iii)  the  transfer  function  is  given  by 

\\G2\\l  =  tTQR,  (3.6) 

where  the  nXn  matrix  Q  satisfies 

0==AQ  +  QA^  -i-V-,  (3.7) 

(iv)  the  solution  Q  to  (3.7)  satisfies  the  bound 

(3.8). 

and  hence 

\\G2\\UtT^R-,  (3.9) 


(v)  all  real  symmetric  solutions  to  (3.1)  are  nonnegative  definite', 

(vi)  there  exists  a  (unique)  minimal  solution  to  (3.1)  in  the  class  of  real  symmetric  solutions; 
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(vii)  ^  is  the  minimal  solution  to  (3.1)  if  and  only  if 

Ke\i{A+y-^£>R„):^Q-,  (3.10) 

(viii)  II  Goo  II 00  <  y  +  Y~^<2^oo  is  Hurwitz,  where  2.  is  the  minimal  solution  to  (3.1); 

(ix)  if  2  is  the  minimal  solution  to  (3.1)  and  ||  Goo  |!  m  <  Y> 

I{G^,y)  =  iT2R^.  (3.11) 

Proof.  The  proof  of  (3.2)-(3.4)  and  (3.6)-(3.9)  is  similar  to  the  proof  of  Lemma  2.1  given  in  [1].  Assuming 
A  is  Hurwitz,  (v)  follows  by  writing  2  -  e^*{y~'^2R^2  +  V]  dr.  Result  (vi)  is  ^ven  by  Theorem 

2.1  of  [3],  while  (vii)  follows  from  Theorem  2.1  of  [3]  and  Theorem  2  of  [7].  Statement  (viii)  follows  from 
[6].  Finally,  (ix)  is  given  in  [5,6],  while  (3.5)  follows  from  (3.11).  □ 

Remark  3.1.  Consider  the  equalized  weight  case  -  z„  so  that  G2  =  G„.  In  this  case  it  follows  from  (3.9) 
and  (3.11)  that 

l|G2ll2'^/(G2,y),  •  (3.12) 

i.e.,  the  entropy  is  an  upper  bound  for  the  /fj  cost  (see  also  [5,6]).  If  the  disturbance  attenuation 
constraint  is  sufficiently  relaxed,  i.e.,  y  -*  00,  then  it  can  be  shown  [5,6]  that  the  entropy  functional  (2.9) 
coincides  with  the  H2  cost,  i.e., 

I(G2,co)  =  IIG2lll^trQR.  (3.13) 

Remark  3.2.  The  treatment  of  the  entropy  functional  appears  to  be  difficult  when  ||  G«  ||  „  =  y.  This  case 
was  not  considered  in  [6]. 

Lemma  3.1  shows  that  the  disturbance  attenuation  constraint  is  enforced  when  a  nonnegative-defi- 
nite  solution  to  (3.1)  is  known  to  exist  and  A  is  Hurwitz.  Furthermore,  all  such  solutions  provide  upper 
bounds  for  the  ff2  performance  ||G2||2-  Also,  if  2  is  the  minimal  solution  to  (3.1),  then  the  entropy 
functional  (2.9)  is  given  by  (3.11).  TTien,  the  combined  Entropy  Control  Problem  can  be  recast  as 

the  following  Auxiliary  Optimization  Problem.  We  shall  say  is  admissible  if  A  is  Hurwitz  and 

l|G„||„<y. 

Auxiliary  Optimization  Problem.  For  [i  s  [0, 1],  determine  admissible  K  e  R'"^"  that  minimizes 

J{K)^litTQR  +  {l-ii)tT2R„,  (3.14) 

where  Q,  2^0  satisfy  (3.7)  and  (3.1). 


4.  Sufficient  conditions  for  optimality 

In  this  section  we  state  sufficient  conditions  for  characterizing  full-state  feedback  controllers  guarantee¬ 
ing  closed-loop  stability  and  constrained  disturbance  attenuation.  For  convenience  in  stating  the  main 
result  we  assume 

R2=Ct^R2t 

\vhere  a,  P  are  real  numbers  and  R  e  R'"^'"  is  positive  definite.  The  general  case  in  which  (4.1)  does  not 
hold  is  discussed  later  in  Remark  4.1.  Also  define 
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Theorem  4.1.  Suppose  there  exist  nXn  nonnegative-defmite  matrices  Q,  P,  satisfying 

0  =  <>l-2M)2  +  e(^-23/)‘^+ K,  (4.3) 

0  =  (^  -  2Mfp  +  P{A  -  SM)  +  pRi  +  pa^M'^SM,  (4.4) 

0  =  {A-2M)2+2{A-SM)^  +  +  +  V,  (4.5) 

O  =  {A-2M  +  y-^£[R,„+P^M'^2M]f^+^{A-2M  +  y-^^[R,„  +  0^M'^J^M]) 

+  (1  -  ti)Rioo  +  (1  -  (4.6) 

and 

]iia^Q  + (1 -/x)/3^J  +  Y“^^^^^.2>0,  (4.7) 

where 


M=  {PQ  +  ^£){pa^Q+(l-p)0^2  +  y~^P^2^£y^,  (4.8) 

and  let  K  be  given  by 

K=  -Rl^B^M.  (4,9) 

Then  (A,  D)  is  stabilizable  if  and  only  if  A  is  Hurwitz.  In  this  case, 

\\G^\\l  =  ^xQ{R,+a^M'^2M),  (4.IO) 

II  <?«,  II ^  y>  (4.11) 

and,  if  ||  (/«,  ||  „  <  Y,  then 

I{G^,y)^tT^{R^^-¥fl^M'^2M).  (4.12) 

If,  in  addition,  A  —2M  +  Y“^^(i?ioo  +  P^M^2M)  is  Hurwitz,  then 

IiG„,  y)  =  tr  B[R,^  +  ^^M'^2M).  (4.13) 


Proof.  First  we  obtain  necessary  conditions  for  the  Auxiliary  Optimization  Problem  and  then  show,  by 
construction,  that  these  conditions  serve  as  sufficient  conditions  for  closed-loop  stability  and  prespecified 
disturbance  attenuation.  Thus,  to  optimize  (3.14)  subject  to  (3.1)  and  (3.7),  form  the  Lagrangian 

^{K,  Q,  2,  P,  4  tr[x[/xQ^  +  (1  -  p)2R^] 

+  {AQ  +  QA^+  V)P+{AJ2+£>A7  +  y-^2R^£+  F)^],  (4.14) 

where  the  Lagrange  multipliers  X^O  and  P,  are  not  all  zero.  By  viewing  K,  Q,  and  .2  as 

independent  variables,  we  obtain 

^  =  a'^P  +  PA  +  \pR,  (4.15) 

9j?  t 

_  =  (^-+y-2.2^^)  &>+^{A+y-^2R^)+X{l-p)R^.  ,(4.16) 

If  both  A  and  A  +  y  ^2R^  are  Hurwitz,  then  X  =  0  implies  P  =  0  and  0.  Hence,  it  can  be  assumed, 
without  loss  of  generality  that  X  =  1,  Furthermore,  note  that  P  and  ^  are  nonnegative-definite.  Thus  the 
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Stationary  conditions  with  X  =  1  are  given  by 

^  =  A'^P  +  PA  +  iiR=^0,  (4.17) 

-^  =  {A  +  y-^M„)  ^+d^{A+y-^2R„)  +  (l-ii)R^  =  0,  (4.18) 

=  11R2KQ  +  (1  -  ii)R2„K2  +  y~^R2ccK^^^  +  B'^iPQ  +  &2.)  =  0.  (4.19) 

Assuming  (4.1),  (4.19)  implies  (4.9).  Next,  with  K  given  by  (4.9),  (4.3)-(4.6)  are  equivalent  to  (3.7),  (4.17), 

(3.1) ,  and  (4.18),  respectively.  It  now  follows  from  Lemma  3.1  that  the  stabilizability  condition  is 
equivalent  to  the  stability  of  A.  In  this  case  the  disturbance  attenuation  constraint  (4.11)  holds,  the 
entropy  is  bounded  as  in  (4.12),  and  the  H2  cost  is  given  by  (4.10).  If,  finally,  A  +  y~^2.R^  is  Hurwitz, 
then  the  entropy  is  given  by  (4.13),  which  is  a  restatement  of  (3.11).  □ 

Remark  4.1.  Condition  (4.1)  was  assumed  for  convenience  only.  When  (4.1)  does  not  hold,  K  is  given  by 

K=  -vec“^{l2"*  vec[5'^(P<2  +  ^^)]}.  (4.20) 

where  ‘vec’  denotes  the  column  stacking  operator,  and  12  is  defined  by 

12  ^  /i^2  ®  <2  +  (1  -  p)R2«  +  y'^Ricc  (4.21) 

where  0  denotes  Kronecker  product.  Since  12  ^  0,  (4.20)  is  valid  if  12  >  0,  which  is  a  generalization  of 
(4.7).  When  (4.1)  does  not  hold,  however,  (4.3)-(4.6)  cannot  be  used  and  must  be  replaced  by  (3.7),  (4.17), 

(3.1)  and  (4.18),  respectively. 


5.  Specializations  of  Theorem  4.1 

To  draw  connections  with  the  existing  literature,  a  series  of  specializations  of  Theorem  4.1  is  now  given. 
We  begin  by  considering  the  case  of  an  entropy  functional  only,  i.e.,  =  0.  In  this  case,  set  /?,  =  0,  a  =  0 

(i.e.,  R2  =  0)  so  that  (4.3)  is  superfluous  and  (4.4)  implies  P  =  0.  Furthermore,  (4.9)  becomes 


-R2lB'^^S  (5.1) 

and  .2,  ^  satisfy 

O  =  {A-2„^S)2+2{A-S„0>sf +  y-^2R2^£  +  y-^p^2S'^^S„^S2+  V,  (5.2) 

0  =  (^  +  y-^£lR,„f^+^{A  +  y-^^Ri„)  +  (5.3) 

where 

+  (5.4) 

S„^BR2lB\  (5.5) 

Next,  by  introducing  the  transformation  Z  =  ^5  =  (^' +y“^)3^.2)“*  and  forming  Z[^“’(5.3)5^“' + 
^^y-\4.2)]Z,  (5.1)-(5.3)  collapse  to 

K=^  -RliB^Z,  (5.6) 

0  =  /1’^Z  +  Z/4  +  R,„  +  y~^ZFZ-ZZ„Z,  (5.7) 
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which  is  the  result  given  in  [9].  Furthermore,  it  can  be  shown  that 

=  (5.8) 

Next,  to  recover  the  standard  LQR  result  from  Theorem  4.1,  set  =  0,  ;8  =  0  (i.e.,  Jljoo  =  0)  and 
/X  =  1  or,  effectively  (see  Remark  2.1),  y  oo.  In  this  case  (4.3)  and  (4.5)  are  superfluous  while  (4.6) 
implies  Sfi—Q.  Furthermore,  (4.9)  becomes 

K=  -RJ  W,  (5.9) 

where  P  satisfies  the  standard  regulator  Riccati  equation 

Q  =  A^P  +  PA+Ri-P2-2P^  (5.10) 

where 

(5.11) 

Furthermore, 

Il<?2ll2  00)  =  trPK  (5.12) 


Note  that  in  this  case  the  //go  performance  bound  (2.6)  is  not  enforced  since  the  entropy  functional  is 
excluded  from  the  optimality  criterion. 

Finally,  it  is  important  to  point  out  a  generalization  of  (5.1)-(5.3).  Specifically,  suppose  as  in  [1]  we  seek 
to  minimize  an  overbound  on  the  //j  cost  while  enforcing  the  disturbance  attenuation  constraint  with 
performance  variables  Z2  z*,,  i.e.,  (3.14)  replaced  by  tr  2.R  and  =  0  so  that  the  actual  cost  is  not 
considered.  Note  that  in  this  case  tr  .2R  is  not  generally  equal  to  /(G^,  y)  and  the  entropy  interpretation 


of  the  performance  is  no  longer  valid.  In  this  case,  (4.3)-(4.6)  and  (4.8)  become 

/<:=  -Ri'-SW,  (5.13) 

where  St,  ^  satisfy 

Q  =  {A-2PS)2  +  St{A-2^sf  +  y-^SlR^„Si  +  y-'^^'^SlS'^^2^SS>+  V,  .(5.14) 

0  =  (^  +  y“^5R,„)V+^(^  +  y”^.2Ri„)  +  R,  -  S^9'ZS>S,  (5.15) 

and 

S^(a^/„  +  y-^/3^.2^)"‘.  (5.16) 

Furthermore, 

II ^2 1|2^ tr  5(R,  +  (5.17) 


It  is  interesting  to  note  that  the  full  state  feedback  overbound  H-JH^  unequalized  weights  case  involves 
two  coupled  equations,  one  modified  Riccati  equation,  and  one  modified  Lyapunov  equation,  unlike  the 
entropy/H^  (equalized  weights)  case,  which  involves  one  modified  Riccati  equation  given  by  (5.7). 
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Robust  Stability  and  Performance  Analysis  for  Linear 
Dynamic  Systems 

DENNIS  S.  BERNSTEIN  AND  WASSIM  M.  HADDAD 

Abstract— In  a  recent  paper  Zhou  and  Khargonekar  obtained  suffleient 
conditions  for  robust  stability  over  specified  sets  of  matrix  perturbations. 
In  the  present  note  these  results  are  extended  to  include,  in  addition, 
perfor,-nance  bounds.  Here  performance  is  defined  as  the  worst-ense 
expected  value- of  a  quadratic  functional  involving  the  stale  variables 
when  the  syslem'is  subjected  to  while  noise  disturbances.  The  results  are 
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illustrated  by  considering  the  gam  margin  of  both  an  LQG  controller  and 
a  robustified  design  obtained  by  Bernstein  and  Greeley  for  Doyle's 
example. 

I.  INTRODUCTION 

It  IS  well  known  that  unavoidable  discrepancies  between  mathematical 
models  and  real-world  systems  can  result  m  the  degradation  of  control- 
system  performance.  Ideally,  feedback  control  systems  should  be 
designed  to  be  robust  with  respect  to  uncertainties  in  the  plant 
charactensucs.  Thus,  robustness  analysis  must  play  a  key  role  in  control- 
system  design.  That  is,  given  an  existing  or  proposed  control  system, 
determine  the  performance  degtadauon  due  to  variations  in  the  plant.  The 
most  fundamental  concern  m  this  regard  is  clearly  that  of  stability.  For 
linear  state-space  systems  with  which  the  present  note  is  concerned,  this 
problem  has  received  increasing  attention  over  the  past  several  years  (see, 
e.g.,  [1]-(21). 

One  of  the  principal  techniques  used  to  assess  robust  stability  is  based 
upon  quadratic  Lyapunov  functions  (see  [l]-[4],  (lOJ).  Quadratic 
Lyapunov  functions  have  also  been  used  extensively  for  robust  control- 
system  synthesis-,  see  [13]  for  relevant  references.  The  problem  of 
robust  synthesis  is,  however,  beyond  the  scope  of  the  present  note. 

In  addiuon  to  assessing  robust  stability,  it  is  often  desirable  to  quantify 
performance  by  considenng  the  degtadauon  of  a  cost  functional  as  the 
plant  parameters  deviate  from  their  nominal  values.  Although  any 
robusdy  suble  system  over  a  compact  set  of  parameters  possesses  a 
worst-case  performance,  it  is  desirable  in  practice  to  acmally  determine  a 
bound  for  the  worst-case  performance.  The  concern  for  both  robust 
stability  and  performance  goes  back  to  the  early  work  of  Michael  and 
Merriam  [14],  while  more  recent  references  include  the  work  of  Chang 
and  Peng  [15],  Noldus  [16],  and  Petersen  [17].  The  results  of  [I5]-[I7] 
can  be  shown  to  depend  upon  a  modified  Lyapunov  equation  of  the  form 

0=AQ+QA^+?l(Q)+y  (1.1) 

where  the  operator  ?l(,Q)  is  chosen  to  bound  terms  of  the  form  AAQ  + 
QAA  ^  where  A/4  is  an  uncertain  perturbation  of  the  dynamics  matrix  /4. 
Since  robust  performance  per  se  was  not  discussed  in  [16],  [17],  the  work 
most  closely  related  to  the  present  note  is  that  of  Chang  and  Peng  [IS]. 
They  esscnually  show  that  consideration  of  (1.1)  leads  to  a  bound  on 
worst-case  performance.  Although  the  development  in  [15]  was  carried 
out  for  full-state  feedback,  specialization  of  their  approach  to  robust 
performance  analysis  is  straightforward.  A  systematic,  in-depth  treatment 
of  robust  performance  analysis  involving  the  approach  of  [15]  as  well  as 
otiier  bounds  is  given  in  [18], 

The  starting  point  for  the  present  note  is  the  recent  paper  by  Zhou  and 
Khargonekar  [10].  By  analyzing  the  Lyapunov  equation  they  obtain  a 
series  of  stability  robustness  tests  which  improve  significantly  upon 
earlier  work  [2]-[4].  In  the  present  note  we  extend  the  results  of  [10]  to 
obtain,  in  addition,  a  bound  on  worst-case  performance.  As  in  (1.1)  we 
consider  a  Lyapunov  equation  of  the  form 

0=AQ+QA^+il+V  (1.2) 

where  0  bounds  uncertainty  terms  of  the  form  AAQ  +  QAA  The 
pnncipal  difference  between  (l.lj  and  ^1.2)  is  that  f)  in  (1.2)  is  a  constant 
matrix  independent  of  the  solution  Q.  The  case  considered  in  [15]  in 
which  n  is  a  function  of  Q  is  discussed  in  [18]. 

The  cost  functional  used  in  the  present  rote  to  quantify  robust 
performance  is  the  trace  of  the  output  covariance  of  a  system  subjected  to 
white  noise  disnirbances.  This  measure  of  performance  is  identical  in 
form  to  the  standard  performance  criterion  of  LQG  theory.  Since  we  also 
obtain  a  bound  for  the  state  covariance  matrix,  our  results  yield  bounds  on 
the  variances  (mean  square  response  levels)  of  system  states.  Although  the 
results  of  [15]  were  obtained  within  a  deterministic  setting,  it  is  easy  to  see 
that  the  performance  criterion  of  [15]  is  also  of  this  form. 

The  contents  of  the  note  are  as  follows.  After  introducing  notation  at  the 
end  of  this  section  we  consider  the  robust  stability  and  performance 
problems  m  Secuon  II.  In  Section  III  we  present  the  main  result  (Theorem 
3. 1)  which  provides  sufficient  conditions  for  robust  stability  over  a  set  of 
parameter  variations  along  with  a  performance  bound.  In  Section  IV  we 
present  a  dual  result  (Theorem  4. 1)  in  terms  of  the  dual  matrix  P.  This 


result  serves  two  purposes.  First,  it  clanfies  connecuons  with  the  previous 
literature  where  results  are  presented  in  terms  of  the  quadrauc  Lyapunov 
function  V(x)  =  x^Px.  And,  second,  we  show  that  the  dual  performance 
bound  may  be  much  better  than  the  primal  bound  (and  vice  versa)  for 
particular  problems.  The  results  of  TTieorems  3. 1  and  4. 1  are  given  in 
terms  of  a  robustness  set  Tl  which  is  a  subset  of  a  maximal  set  “ti.  Since  Ti 
IS  defined  impbcitly,  we  provide  explicit  charaaenzauons  of  subsets  TI  in 
Section  V.  Here  we  restate  the  pnncipal  results  of  (2]-[4],  [10]  which,  Jn 
our  context,  correspond  to  particular  charactenzauons  of  subsets  of  Tl. 
We  also  introduce  an  addiuonal  subset  of  Tl  which  provides  a  new  robust 
stability  result.  Finally,  in  Section  VI  we  consider  a  pair  of  illustrative 
examples.  The  first  example,  which  was  previously  considered  in  [10], 
mvolves  two  uncertain  parameters.  It  is  shown  that  the  new  guaranteed 
stability  region  is  considerably  larger  for  certain  parameter  values  than  the 
regions  given  m  [10]  (see  Fig.  1).  Furthermore,  we  obtain  a  robust 
performance  bound,  a  result  which  has  no  counterpart  in  [10].  The  second 
example  involves  controllers  for  a  second-order  open-loop  unstable  plant 
originally  considered  m  [19]  to  demonstrate  the  lack  of  a  guaranteed 
stability  margin  for  LQG  controllers.  We  apply  Theorems  3  1  and  4  1  to 
analyze  both  the  LQG  design  and  a  robusufied  design  obtained  in  [20], 
We  show  that  the  new  robust  stability  test  is  effective  in  the  sense  that  the 
guaranteed  gam  margin  for  the  robusufied  controller  is  a  factor  of  5 
larger  than  the  actual  gain  margin  of  the  LQG  design. 

Notation 

Note:  All  matrices  have  real  entries 

a,  h',  2  Real  numbers,  r  x  s  real  matrices,  3'* ', 

expectation 

I,  r  X  r  identity  matrix 

Asymptotically  stable  matrix  Mauix  with  eigenvalues  in  the  open  left- 

half  plane 

S3',  S’'  r  X  r  symmetric,  nonnegatlve-defmite, 

positive-definite  matrices 

Z,  a  Z:,  Z,  >  Z:  Z,  -  Zi  €  33',  Z,  -  Zj  6  Z„ 

Zj  e  45' 

tr  Z,  Z^,  CO  Trace  of  Z,  transpose  of  Z,  convex  hull 

Km(Z),  Xo«(Z )  Smallest  and  largest  eigenvalues  of 

Z  €  45' 

||Z||,  Spectral  norm 

Z(,j)  (/,  j )  element  of  matrix  Z 

Z  a  a  0  Z(,.y)  a  0,  /,  y  =  1,  •••,/■,  Z  £  i)'*' 

Z  ►  0  Z(j,;)  >  0,  i,j  =  1,  Z  £ 

\Z\„  {|Z„.;,l}Cj.,,Z£  a'*' (matrix 

modulus). 

n.  ROBUST  Stability  and  Perfor.mance  proble.ms 

Let  Tl  C  denote  a  set  of  perturbations  AA  of  the  nominal 
dynamics  matrix  A.  Throughout  the  note  it  is  assumed  that  A  is 
asymptotically  stable.  We  begin  by  considering  the  question  of  whether  or 
not  /4  +  A/4  is  asymptotically  stable  for  all  A/1  £  Tl. 

Robust  Stability  Problem.  Determine  whether  the  linear  system 

X(r)  =  (A  +  AA)x(t),  r  6  [0, 00)  (2.1) 

is  asymptotically  stable  for  all  AA  £  Tl. 

The  problem  of  robust  performance  involves  a  quadratic  form 
x^(t)Rx(t),  where  R  £  M",  when  the  system  is  subjected  to  a  white 
noise  disturbance  »v(r)  with  nonncgative-defimte  intensity  y.  The  matrix 
R  can  be  viewed  as  a  means  for  selecting  output  variables  of  interest  while 
the  matrix  V  can  be  used  to  specify  disnirbance  levels. 

Robust  Performance  Problem:  For  the  disturbed  linear  system 

x(0  =  (/4+A/l)x(r)+w(r).  r£[0,oo)  .  (2.2) 

determine  a  performance  bound  S  satisfying 

y(Tl)  S  sup  lim  sup  2[.ir'’(r)/?x(r)]£/3.  (2.3) 
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The  system  (2.2)  may,  for  example,  denote  a  control  system  in  closed- 
loop  configuration  subjected  to  external  white  noise  disturbances  (see 
Section  VI).  Such  specializations  are  ntH  required  for  this  development, 
however.  Note  that  ^(Tl)  represents  the  worst  case  (over  Tl)  of  the 
average  (over  the  white  noise  statistics)  of  quadratically  weighted  steady- 
state  deviations  of  the  state  from  the  origin.  Thus,  0  represents  an  upper 
bound  on  selected  output  variances. 

Of  course,  since  R  and  V  are  only  assumed  to  be  nonnegative  definite, 
there  may  be  cases  in  which  a  finite  performance  bound  0  satisfying  (2.3) 
exists  while  (2.1)  is  not  asymptotically  stable  over  Tl.  In  practice, 
however,  robust  performance  is  mainly  of  interest  when  (2.1)  is  robustly 
stable.  In  this  case  the  performance  /(Tl)  is  given  in  terms  of  the  steady- 
state  second  moment  of  the  state.  The  following  result.from  linear  system 
theory  will  be  useful. 

Lemma  2.1:  Suppose  (2.1)  is  asymptotically  stable  for  all  Aid  €  Tl. 
Then 

y(Tt)=  sup  uQ^R  (2.4) 

A/IE'U 

where  n  x  n  &  lim,-,  ilWl)Ar^(r)]  is  the  unique,  nonnegative- 
definite  solution  to 

0={A+^A)Qi^  +  QiA{A+e^y+V.  (2.5) 

In  the  present  note  our  approach  is  to  obtain  sufficient  conditions  for 
robust  stability  as  a  consequence  of  sufficient  conditions  for  robust 
performance.  Such  conditions  are  developed  in  the  following  sections. 

m.  SUFnCIENT  CONOmONS  FOR  ROBUST  STABIUTY  AND 
PERFORMANCE 

The  key  step  in  obtaining  robust  stability  and  performance  is  to  replace 
the  uncertain  terms  in  the  Lyapunov  equation  (2.5)  by  a  bounding  matrix 
0.  The  nonnegative-definite  solution  Q  of  this  funding  Lyapunov 
equau’on  is  then  guaranteed  to  be  an  upper  bound  for  Q^a.  The 
uncertainty  set  Tl  over  which  robustness  is  guaranteed  then  depends  upon 
Q  The  following  easily  proved  result  is  fundamental  and  forms  the  basis 
for  all  later  developments.  The  hypotheses  of  this  result  are  of  a  general 


namre  and  are  not  intended  to  be  directly  verifiable.  Suitably  verifiable 
specializations  of  the  hypotheses  are  discussed  in  Section  V. 

Theorem  3.1:  Let  0  S  W",  let  Q  6  be  the  unique  solution  to 


o=AQ+QA^+a+y 

(3.1) 

and  let  Tl  be  a  subset  of 

•U  i  {A.4  e  35'”''’ :  CiAQ+Q&A^^U}. 

(3.2) 

Then 

(/1+Ai4,  {V+Q-(^Q+Q\A^\''^)  is  subilizable. 

A/1  £  Tl 

(3.3) 

if  and  only  if 

/1+A/l  is  asymptotically  stable,  A/1  £  Tl. 

(3.4) 

In  this  case. 

QiA^Q,  A/1  £  Tl 

(3.5) 

where  S  W'’  is  given  by  (2.5),  and 

y(Tl)strGf?. 

(3.6) 

If,  in  addition,  there  exists  A.4  €  *0.  such  that  (A  +  AA,  [V  +  Q  - 
(A/IQ  +  QA/l  01''*)  is  controllable,  then  Q  is  positive  definite. 

Proof:  This  result  is  a  minor  variation  of  [21,  Theorem  3.1]  and 
hence  the  proof  is  omitted,  □ 

To  apply  Theorem  3.1,  one  first  chooses  a  nonnegative-definite  matrix 
n  and  then  solves  (3.1)  for  Q.  Next,  as  shown  in  Section  IV,  one 
examines  ‘tL  to  determine  subsets  Tl  of  perturbations  A/1  over  which 
robustness  is  guaranteed.  Note  that  if  Tl|  and  Tl:  arc  subsets  of  Tl,  then  so 
is  the  convex  hull  of  their  union.  (To  see  this  note  that  Ti,  is  convex.)  The 
set  is  the  largest  set  over  which  robustness  can  be  guaranteed  by 
Theorem  3.1  for  the  particular  choice  of  fl.  One  may  also  select  severi 
matrices  (1  and  determine  subsets  of  each  resulting  'll  as  a  constructive 
approach  to  determining  larger  robustness  sets.  In  the  next  section  we 
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examine  subsets  “U  of  Ti  of  specified  structure.  Befoi;e  doing  so,  we  have 
the  following  observations. 

In  applying  Theorem  3. 1  it  may  be  convenient  to  replace  condition 
(3.3)  with  stronger  conditions  which  are  easier  to  verify  in  practice.  The 


following  result  is  immediate. 

Proposition  3.1:  Consider  the  conditions 

l'>0  (3.7) 

{A+^'A,  K''^)  is  stabilizable,  ^A  6  “U,  (3.8) 

^AQ+Q^A^<n,  CsA  e  ni,  (3.9) 

^AQ+QC^.^<^l+V,  A/1  €  <4.  (3.10) 


Then  (3.7)  =»  (3.8)  =»  (3.3),  (3.7)  =»  (3.10)  =»  (3.3),  and  (3.9)  «  (3.10) 
=»  (3.3). 

If  only  robust  stability  is  of  interest,  then  the  noise  intensity  V  need  not 
have  physical  significance.  In  this  case  one  may  either  set  V  =  tl„,  where 
«  >  0  is  small  to  satisfy  (3.7),  or  set  I'  =  0  and  confine  'll  to 
perturbations  A/1  for  which  (3.9)  holds.  This  is  the  case  in  [3],  [4],  [10] 
where  V  =  0,  fl  =  2I„,  and  the  parametric  robustness  sets  are 
characterized  by  strict  inequality. 

Remark  3.1:  Since  A  is  asymptotically  stable,  Q  is  given  by 

C=  r  e'«(0+  V)e''^'  dt=  r  dt+Qo  (3.11) 

Jo  Jo 

where  Qo  €  ?)'’  is  given  by 

0=AQa+QoA^+y.  (3.12) 

Note  that  Qo  £  Q  and  that  the  nominal  performance  is  given  by  tr  QoR- 

Remark  3.2:  Using  (3.11)  it  is  also  useful  to  note  that  the  bound  for 
y(Tl)  given  by  (3.6)  can  be  written  as 

tr  QJ?  =  tr  r  e*'('a+  V)e*'^' dtR^^xr  Po(n+  n  (3.13) 

Jo 

where  Po  S  I’]"  is  given  by 

0=A^Po+PoA+R.  (3.14) 

The  bound  tr  Po{0  -t-  V)  can  be  viewed  as  a  dual  formul.'ition  of  the 
bound  tr  QR  since  the  roles  of  A  and  /I  ’’are  reversed.  Dual  bounds  are 
developed  in  the  following  section.  Note  that  tr  QoR  =  tr  Po  K. 

rv.  Dual  Sufficient  Conditions  for  Robust  stability  and 
PERFOR.MANCE 


where  n  x.  n  P^a  is  the  unique.  nonnegative.definite  solution  to 

0=(/1+A/1)’’Pw+Pih(/1+A/1)+R.  (4.2) 

The  dual  of  Theorem  3.1  can  now  be  stated. 

Theorem  4.1:  Let  A  S  W",  let  P  £  M"  be  the  unique  solution  to 

0=A’'P+PA+A+R  (4.3) 

and  let  'll  be  a  subset  of 

Ti'  i  [A/l  eil'”‘":A/l’’P+PA/lsA}.  (4.4) 

Then 

((P  +  A-(A/1’’P+PA/1)]''’, /I  +  A/1)  is  detectable.  A/1  €  "U,  (4.5) 
if  and  only  if 

A+AA  is  asymptotically  stable,  AA  €  “U.  (4.6) 

In  this  case. 

Pj^^P,  Ay4  6  Tl  (4.7) 

where  P^a  €  is  given  by  (4.2),  and 

y(‘U)£trPI'.  (4.8) 

If,  in  addition,  there  exists  AA  €  Ti'  such  that  ([P  +  A  —  (A/1  rP  + 
PA^)]”^,  A  +  A/1)  is  observable,  then  P  is  positive  definite. 

The  usefulness  of  Theorem  4. 1  resides  in  the  fact  that  it  provides 
stability  and  perfonrance  bounds  which  are  generally  different  from  those 
given  by  Theorem  3.1.  Hence,  depending  upon  0  and  .A  either  bound 
(3.6)  or  bound  (4.8)  may  be  better  for  a  particular  problem.  To  illustrate 
how  dual  bounds  can  improve  estimates  of  robust  performance,  consider 
the  case  in  which  =  0,  i.e.,  plant  disturbances  are  absent.  In  this  case 
Q^a  =  0  sau'sfies  (2.5)  and  thus  /(Tt)  =  0  as  long  as  A  +  A/1  is  stable 
for  all  Aj4  6  'll.  The  performance  bound  tr  QS-giveri  by  (3.6)  may, 
however,  be  arbitrarily  large  depending  upon  R  since  (2  *Wy.te  nonzero 
due  to  (2.  Hence,  this  performance  bound  may  be  arbitrarily  con^rvalivie. 
The  dual  bound  (4.8),  on  the  other  hand,  is  zero  in  this  case,  which 
completely  eliminates  the  conservatism. 

V.  CHARACTERIZATION  OF  SUBSETS  OF  Tl  AND  *&' 

To  apply  Theorems  3. 1  and  4. 1  it  is  necessary  to  explicitly  characterize 
subsets  Tl  of  and  'll  ’  over  which  robustness  is  guaranteed.  In  this 
section  we  provide  several  such  characterizations  by  collecung  together 
and  extending  known  results  from  the  literature. 

For  the  following  result  let  Q  =  uA,,  where  w  >  0,  let  H'  S  'P'”"’,  W 
>  0.  and  let  /li,  •  -  • ,  /l^  €  il'""'  be  arbitrary.  Furthermore,  for  Q  6 
?'*  satisfying  (3.1)  define  for  /  =  1, 


As  noted  in  Remark  3.2,  the  performance  bound  tr  QR  given  by  (3.6) 
can  be  expressed  equivalently  in  terms  of  a  dual  variable  Po  for  which  the 
roles  of  A  and  ,4  ’’  are  reversed.  Using  a  similar  technique,  additional 
conditions  for  robust  stability  and  performance  can  be  obtained  by 
developing  a  dual  version  of  Theorem  3.1.  A  prime  motivation  for 
developing  such  dual  bounds  is  to  draw  direct  connections  with  previous 
results  in  the  literature  relating  to  robust  stability.  Traditionally,  the  use  of 
the  quadratic  Lyapunov  function  V(x)  =  x^Px  for  robust  stability  leads 
namraliy  to  the  dual  formulation.  In  addition,  the  dual  bounds  may.  for 
certain  problems,  be  much  sharper  than  the  bounds  introduced  in  the 
previous  section.  This  point  is  illustrated  at  the  end  of  this  section  by 
examining  an  extreme  case  and  in  Section  VI  by  means  of  numerical 
examples.  We  note,  in  addition,  that  robust  performance  bounds  are  more 
difficult  to  motivate  within  the  dual  formulation  without  first  developing 
the  primal  results.  The  following  result  is  immediate. 

Lemma  4.1:  Suppose  (2.1)  is  asymptotically  stable  for  all  AA  £  *U. 
Then 


y('U)=  sup  trPwt'  (4.1) 


<X(  -  l^ma{AiQ+QAf), 
3,  S  (-00  ,  00) 

&  (-00,  „/ft), 

&  (u/ofi,  00), 

H  (u/ot/,  w/ft). 


A  ^  l^^,(A,Q-i-QAf}, 
flr,=A=0. 
ot,aO.  ft>0, 
ot(<0,  ftsO, 

Oi<0<A. 


Finally,  let  e]”^  denote  the  ith  column  of  thep  X  p  identity  matrix. 

Proposition 5.1:  LaQ  £  P** satisfy  (3. 1)  with h  =  w/„,\vhereu  > 
0.  Then  the  following  sets  are  subsets  of  'll  which  also  satisfy  (3.9): 

■U,  I^A/1  €  Jl"-"  :  aA/lB,<|BC!i,-'j  . 

•U:  i  [A/l  £  :  jA/lU  •<  ^VnQU+lQU»'%~'^}. 

■U,  S  I  A/1  €  Jl-'"  :  A/1  =  2  (<’>-  ^  ® 

V.  1-1 
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where  (R  is  one  of  the  following  regions  in  il”: 


<Ri  <rp) :  2  • 


^  j  (<ri.  <fp) :  2  ®i<“‘  S 

L  i-t  t-i 

ill  ^  I  (<ri.  Op)  ■  kl<u  2  \A,Q+QA[\„ 


'’’il"]  • 


/=i.— .pj . 


(R4  H  CO  {a,ej/’ :  <r/  €  3/,  1=  I,  •  ■  p}. 

For  (he  dual  case  we  set  A  =  \f„,  where  X  >  0.  and  define  the  dual 
sets  'll,',  Hj,  Tij ,  3j',  (R <Rj,  <Rj ,  and  <R^  in  an  analogous  fashion. 

Remark  5.1:  The  proof  of  Proposmon  5.1  is  omitted  since  the  results 
are  either  known  or  are  immediate.  Specifically.  RL,'  can  be  found  in  [2] 
while  Rlj  appears  in  [3],  [4].  The  sets  <R,',  (Rj,  and  (R,  are  given  in 
[10].  The  set  ^  4  has  not  appeared  previously  in  the  literature  although  the 
result  is  immediate.  It  is  only  necessary  to  diagonalize  >4 fP  -I-  PAi  by 
means  of  an  orthogonal  transformation  and  compare  diagonal  elements  to 
obtain  3/.  Taking  the  convex  hull  over  the  intervals  3/  thus  yields  <R^. 
Of  course,  the  required  eigenprofalem  entails  additional  computation. 

Remark  5.2:  Although  most  of  the  dual  of  Proposition  S.l  has 
appeared  previously,  the  primal  result  Proposition  S.l  has  not  been 
discussed  in  the  literanire.  For  robust  stability  this  result  can  be  obtained 
by  considering  the  stability  of  A  ^  in  place  of  A.  As  will  be  shown  in 
Section  VI,  the  primal  and  dual  results  lead  in  general  to  different  robust 
stability  regions  and  performance  bout^.  It  should  also  be  stressed  that 
althougli  most  of  the  dual  of  Proposition  5. 1  has  appeared  previously,  tte 
present  note  extends  its  applicability  to  the  problem  of  robust  performance 
in  addition  to  robust  stability. 

Remark  5.3:  As  mentioned  previously,  the  convex  hull  of  the  union  of 
any  collection  of  subsets  of  ‘5.  is  also  a  subset  of  'll  since  *U.  is  convex. 
This  observation  applies  to  "Uj  in  the  sense  that  if  Rl]  is  a  subset  of ‘0.  with 
regions  (R  =  di  and  (R  =  (R  separately,  (hen  Rl]  is  al»  a  subset  with  (R 
equal  to  the  convex  hull  of  (he  union  of  di  and  (A.  Note  that  these 
observations  follow  from  the  convexity  of  Rl  and  do  not  contradict  the  fact 
(hat  (he  set  of  asymptotically  stable  matrices  is  not  convex. 

Remark  5.4:  The  requirement  that  Q  be  of  the  form  u/,  is  not  a 
constraint  in  applying  Proposition  3.1.  Indeed,  it  is  only  requited  that  Q  be 
positive  definite.  To  see  this  let  invertible  d  S  71**"  be  such  that  oQo^ 
=  In.  Then  Proposition  S.l  can  be  applied  with  suitable  transformations 
of  Ai4,  Q,  W,  and  Ai. 

Remark  5.5:  As  in  (2J-(4],  [10],  the  sets  Rl„  Rlj,  31,.  tRj.  and  (R^  are 
defipied  in  terms  of  strict  inequalities.  In  (his  case  Rl,.  Rl*.  and  Rlj  consist 
ofelements  of  Rl  satisfying  A<4Q  QAA^  <  Q  so  (hat  (3.9)  is  satisfied. 
Thus,  by  Proposition  3.1.  the  stabilizability  condition  (3.3)  is  automati¬ 
cally  satbfied  without  reference  to  K. 

Remark  5.6:  In  the  special  case  p  =  1  it  is  clear  that  <R,  =  (Rj. 
Furthermore,  in  this  case  (R,  is  always  a  subset  of  (R,  and  IR;,  and  hence 
leads  to  a  more  conservaave  stability  region.  The  largest  possible  set  of 
perturbations  A/1  of  the  form  OiAi  contained  in  Rl  is  given  by  tR(. 

Remark 5.7:  It  is  shown  in  [10,  Remark  2. 12]  that  RI2  can  teobuined 
as  a  consequence  of  Rlj  with  <R  =  (Rj  and  a  suitable  choice  of /l|.  Hence. 
Rlj  need  not  actually  be  considered  separately.  Our  assumption  tlut  IP'  > 
0  (and  not  IP  &  &  0)  is  for  convenience  only. 

Remark  5.8:  Note  that  all  of  the  subsets  of  Rl  given  by  Proposiuon  5. 1 
are  symmetric  except  for  Rlj  with  <R  =  (R,.  When  the  actual  stability 
region  is  highly  asymmetric,  it  follows  (hat  a  symmetric  robust  subility 
region  is  necessarily  highly  conservative.  This  observation  is  illustrated 
by  an  exampleiin  S^on  VI. 

Remark  5.9:  The  regions  given  by  (R,.  (R*.  and  (Rj  correspond, 
respeaively.  to  l-norm  2-norm,  and  co.rxxm  r>eighbodioods.  These 
results  can  easily  be  extended  to  include  more  general  regions.  For 
example,  in  the  definition  of  (Rj  replace  o>  by  0//o>  and  AiQ  *  QA  fby 


o, (AiQ  +  QAj),  where  o,-  is  an  arbitrary  positive  constant.  /  =  I,  •  • 

p.  With  this  m^ificatlon  (Rj  corresponds  to  an  elliptical  robust  stability 
region.  Detailed  investigation  of  such  regions  is  beyond  the  scope  of  this 
note. 

Remark  5.10:  When  each  interval  3i  is  finite,  or  when  only  a  finite 
interval  is  of  interest.  (Rx  can  be  expressed  as  the  convex  hull  of  a  finite 
number  of  points.  Specifically.  letung  3/  =  [a,,  bi],  i  =  1,  ••■,p,it 
follows  that 

(R,=co  {ff,e'«,  b,e'/>.  ---,  a.e'^,  b.e'^}. 

This  set  is  illustrated  by  means  of  an  example  in  the  next  section. 

VI.  EXA.MPLES 

As  a  first  example  we  adopt  Example  2  of  [10].  'Ihis  example,  which 
involves  two  urxertain  parameters,  was  used  in  [10]  to  illustrate  the  robust 
stability  regions  (R (R ( ,  and  <R  j .  The  problem  was  originally  cast  in  the 
form  of  a  static  output  feedback  controller  wnth  uncertain  gains.  Here  for 
convenience  in  discussing  robust  performance  we  reformulate  the 
example  to  involve  uncertainty  in  the  controi  input  matrix.  Hence, 
consider  the  control  system 

x{r)=/l*x(r)+5i,u{r).  (6.1) 

y(t)=CtxU).  (6.2) 

«(0=A>(r)  (6.3) 


and  the  uncertainty  ABo  in  jBo  is  given  by 


'  -e,  0 

,=  0  -tf; 

_  -o, 


The  closed-loop  dynamics  matrix  is  then  given  by 


A  -i-AA  = 


'-2-r<r,  0 

1=  0  -3+0:  0 

—  l+Oi  —  l+U;  —4  +  0% 


where  AA  =  a,A,  4-  e-Aj  and  A,.  A*  have  the  evident  definitions.  It 
can  easily  be  shown  that  the  exact  stability  region  is  given  by  <r,  €  ( -  00, 
1.75)  and  o;  E  (-<»,  3).  Thus,  the  ntmiinal  dynamics  matrix 
corresponding  to  a,  =  a>  =  0  lies  in  the  upper  nght-hand  comer  of  the 
exaa  sability  region  so  that,  as  noted  in  Renurk  3.S.  a  high  degree  of 
conservatism  can  be  expected  using  symmetric  robustness  r^ons.  To 
consider  robust  subility  alone,  set  K  =  R  =  0  and  w  =  \  =  2.  In  this 
case  regions  (R,',  (Rj.  and  iRj.  as  computed  in  [10].  are  shown  in  Fig.  I. 
Region  (R’  for  this  problem  is  given  (see'Remark  3.10)  by 

which  accounts  somewhat  better  for  (he  asymtseay  of  (he  sability  re^on. 
The  regions  <R,.  (Rj,  and  (Rj  were  found  to  be  smaller  than  the 
corresponding  dual  tenons,  while  iR,  is  given  by 

whidi  yields  slight  improvemertt  in  u, . 

To  evaluate  robust  performance  replace  (6.1)  by 

x{t)=A^(i)+^u(/)+ir(f)  (6.4) 
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and  define 

J=  lim  '£[x^t)RiX(l)  +  u’'(l)Riu(t)] 

which  corresponds  to  (2.3)  with /f  =  Hence,  setting 

i?i  =  /j  and  Ri  =  Ii  yields 


natural  tradeoff  between  stability  and  performance.  In  general,  to 
determine  the  largest  stability  regions,  V  and  R  should  be  set  to  zero 
initially. 

As  a  second  example  we  consider  the  control  system  given  in  [19]  to 
demonstrate  the  lack  of  a  guaranteed  gain  margin  for  LQG  controllers. 
Hence,  consider 


2  0  1 

MO=AoXoU)  +  B'(,u{t)  +  w,U), 

(6.5) 

R  = 

0  2  0 

I  0  2 

y(.l)  =  CoXoU)  +  Wi{i) 

(6.6) 

We  also  set  V  =  Ij  and  u  =  ) 

^  =  2.  The 

:  resulting  stability  region  for 

with  controller 

these  values  of  V  and  R  is  given  by 

xM=A^M<-B,yU), 

(6.7) 

(R,'  =  {(<7i,  <7:) : 

|<ri|/0.70  +  |<r2|/1.46<l}. 

uU)  =  CcXcU) 

(6.8) 

<Rj={(<7i.<72)  :a?+<7j<(0.70)7}, 

and  performance 

(Rj'  =  {(<7i,  <72)  :  |<7/|<0.68,  /=1,  2}, 

y=lim  S(jff(/)/?|Xo(r)-Kr7'(r)/j2«(/)l. 

(6.9) 

(R,'  =co 


•20.5 


0.70 

0 


’(-?3.7)'(l.46);  • 


The  data  are 


Over  these  combined  regions  the  performance  bound  was  computed  to  be 
W  PV  =  2.26.  The  primal  result  produced  the  regions 

<Ri  =  {(0|.  <72) :  |a,|/1.09  +  i<;i|/I,75<l}, 

<R2={(<7l,<72):<7f  +  <7i<(1.08)*}, 

<fij  =  {(<7i,  (7:) :  |<7/|<1.0,  /=1,  2}, 

Over  these  regions  the  performance  bound  was  computed  to  be  tr  QR  = 
3,18.  Contour  plots  of  actual  performance  for  perturbed  values  of  <J\  and 
<72  are  shown  in  Fig.  2.  Note  that  when  determining  robust  performance 
Theorems  3.1  and  4.1  yield  performance  bounds  over  robust  stability 
regions  which  are  generally  smaller  than  the  robust  stability  regions 
determined  with  R  =  0  and  V  =  0.  This  mechanism  represents  the 


o=[j  |].5o=[?].c-o=no], 

where  ”  md  1^2  are  the  intensities  of  Wilr)  and  Wi(l),  respectively. 
Uncertainty  A5o  in  Bo  is  thus  represented  by  <7iSi,  where  B,  =  [0,  1]^. 
Thus,  the  closed-loop  system  corresponds  to 

where  the  zero  in  the  (2,  2)  block  of  R  denotes  the  fact  that  we  are 
considering  the  robust  performance  bound  for  the  state  regulation  cost 
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J(xlO^) 


only.  Choosing  p  =  60,  it  follows  that  the  LQG  gains  are  given  by 
-4- [-to  _'9].5c=[|J].C=(-10-101. 

For  this  controller  the  acnial  stability  region  corresponds  to  <T|  €  ( -  0.07, 
0.01)  (see  Fig.  3).  Applying  the  results  ofSection  V  with  V  =  R  =  0  (for 
robust  stability  only)  and  oj  =  \  =  2,  we  obtain 

(R,  =  (Rj=:{Rj  =  (-0.000242,  0.000242),  (R,  =  (- 0.000242,  0.000728), 

(R ;  =  m '  =  ( - 0  '’090247,  0.0000247),  (R/  =  ( - 0.0000219,  0.0000219), 

(R;  =(-0.0000247,  0.0000265). 

Note  that  although  the  primal  results  are  better  than  the  dual  results  by  an 
order  of  magninide,  they  are  conservative  by  two  orders  of  magnitude 
with  re.spect  to  the  acmal  gain  margin.  For  robust  performance  we  again 
set  w  X  =  2  and,  using  R  and  V given  above,  we  obtained  the  bound  tr 
QR  =  7633  over  the  stability  region  614  =  (-0.000192, 0.000613).  The 
nominal  performance  was  given  by  tr  QoR  =  tr  Pol'  =  4875,  while  the 
dual  performance  bound  was  trPK=  10510over61^  =  (-0.0000222, 
0.0000238). 

Robustified  controllers  for  the  example  of  (191  were  obtained  in  (20J 
using  the  approach  discussed  in  [13].'  As  shown  in  Fig.  3  (see  also  (20)), 
the  closed-loop  system  with  the  controller 

n  -  r  “-69 

[26.67 

is  stable  over  the  range  at  S  (-0.28,  0.21).  Hence,  we  wish  to 
determine  whether  the  robust  stability  tests  are  capable  of  detecting  this 
increase  in  gain  margin.  Applying  Theorems  3. 1  and  4. 1  with  oj  =  X  =  2 
and  I'  =  R  =  0  yields  stability  for  <T|  in  the  regions  6l|  =  dlj  =  6lj  = 
(-0.0115,  0.0115)  and  6I4  =  (-0.0115,  0.057).  This  guarantee  of 
stability  is  two  orders  of  magnitude  greater  than  the  guarantee  for  the 
LQG  design  but  is  still  an  order  of  magnitude  conservative  with  respect  to 


.Q=(-< 


the  actual  stability  region  for  this  controller.  Note,  however,  that  for  at  > 
0  the  guaranteed  gain  margin  for  the  robustified  design  given  by  6I4  (i.e., 
0.057)  is  greater  than  the  actual  gain  margin  of  the  LQG  design  (0.01). 
Hence,  the  robustness  te»;  given  by  the  6U  was  able  to  detect  a  factor  of  5 
stability  augmentation  provide  by  the  robustified  design  compared  to  the 
LQG  controller.  Finally,  the  robust  performance  bound  for  this  controller 
was  computed  to  be  tr  QP  =  11185  over  the  region  6)4  =  (-0.00165, 
0.00493),  while  the  dual  bound  was  found  to  be  tr  P  I'  =  1 1223  over  (R^ 
=  (-0.000724,  0.00123).  For  this  problem  the  nominal  performance  is 
tr  QoR  =  tr  Pol'  =  9997. 
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Abstract.  For  a  ^ven  asymptotically  stable  linear  dynamic  system  it  is  often  of  interest  to  determine 
whether  stability  is  preserved  as  the  system  varies  Mthin  a  specified  class  of  uncertainties.  If,  in  addition,  there 
also  exist  associated  performance  measures  (such  as  the  steady-state  variances  of  selected  state  variables),  it  is 
desirable  to  assess  the  worst-case  performance  over  a  class  of  plant  variations.  These  are  problems  of  robust 
stability  and  performance  analysis.  In  the  present  paper,  quadratic  Lyapunov  bounds  used  to  obtain  a  simultaneous 
treatment  of  both  robust  stability  and  performance  are  considered.  The  approach  is  based  on  the  construction 
of  modified  Lyapunov  equations,  which  provide  sufficient  conditions  for  robust  stability  along  with  robust 
performance  bounds.  In  this  paper,  a  wide  variety  of  quadratic  Lyapunov  bounds  are  systematically  developed 
and  a  unified  treatment  of  several  bounds  developed  previously  for  feedback  control  design  is  provided. 

Key  words,  robust  analysis,  stability,  performance,  Lyapunov  equations,  structured  uncertainty 
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1.  Introduction.  Unavoidable  discrepancies  between  mathematical  models  and  real- 
world  systems  can  result  in  degradation  of  control-system  performance  including  insta¬ 
bility  [1],  [2].  Ideally,  feedback  control  systems  should  be  designed  to  be  robust  with 
respect  to  uncertainties,  or  perturbations,  in  the  plant  characteristics.  Such  uncertainties 
may  arise  either  due  to  limitations  in  performing  system  identification  prior  to  control- 
system  implementation  or  because  of  unpredictable  plant  changes  that  occur  during 
operation.  Thus  robustness  analysis  must  play  a  key  role  in  control-system  design.  That 
is,  given  an  existing  or  proposed  control  system,  determine  the  performance  degradation 
due  to  variations  in  the  plant. 

In  performing  robustness  analysis  there  are  two  principal  concerns,  namely,  stability 
robustness  and  performance  robustness.  Stability  robustness  addresses  the  qualitative 
question  as  to  whether  or  not  the  system  remains  stable  for  all  plant  perturbations  within 
a  specified  class  of  uncertainties.  A  related  problem  involves  determining  the  largest  class 
of  plant  perturbations  under  which  stability  is  preserved.  Once  robust  stability  has  been 
ascertained,  it  is  of  interest  to  investigate  quantitatively  the  performance  degradation 
within  a  given  robust  stability  range.  In  practice  it  is  often  desirable  to  determine  the 
worst-case  performance  as  a  measure  of  degradation. 

The  concern  for  both  robust  stability  and  performance  can  be  traced  back  to  the 
earliest  developments  in  control  theory.  Design  specifications  such  as  gain  and  phase 
margin  have  traditionally  been  used  to  gauge  system  reliability  in  the  face  of  uncertainty. 
In  the  modem  control  literature  considerable  elfort  has  focused  on  rigorous  robustness 
analysis  and  design  techniques  in  a  variety  of  settings.  Analysis  and  synthesis  results  have 
been  developed  for  both  state-space  and  frequency-domain  plant  models  to  address  struc¬ 
tured  parameter  variations  as  well  as  normed-neighborhood  uncertainty  [3]-[7]. 

The  present  paper  is  concerned  solely  with  the  analysis  of  stmctured  real-valued 
parameter  uncertainty  within  the  context  of  state-space  models.  One  motivation  for  such 
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problems  is  illustrated  by  the  examples  given  in  [1]  and  [2],  These  examples  show  that 
standard  linear-quadratic  methods  used  to  design  either  full-state  feedback  controllers 
or  dynamic  compensators  may  result  in  closed-loop  systems  that  are  arbitrarily  sensitive 
to  structured  real-valued  plant  parameter  variations.  A  particularly  effective  technique 
for  analyzing  robust  stability  is  to  construct  a  quadratic  Lyapunov  function  F(x)  = 
x^Px,  which  guarantees  stability  of  the  system  as  the  uncertain  parameters  vary  over  a 
specified  range.  This  technique  has  been  extensively  developed  for  both  analysis  and 
synthesis  {see,  e.g.,  {8j-[37]). 

Although  both  robust  stability  and  performance  are  of  interest  in  practice,  most  of 
the  literature  involving  quadratic  Lyapunov  functions  is  confined  to  the  problem  of 
robust  stability.  A  notable  exception  is  the  early  work  of  Chang  and  Peng  [9],  which 
also  provides  bounds  on  worst-case  quadratic  performance  within  the  context  of  full- 
state-feedback  control  design.  In  the  present  paper,  we  further  extend  the  approach  of 
[9]  to  obtain  a  series  of  results  for  analyzing  both  robust  stability  and  performance.  As 
will  be  se-jn,  these  results  also  provide  substantial  unificai  of  more  recent  results  per¬ 
taining  to  robust  stability  alone. 

To  illustrate  the  basis  for  our  approach,,  consider  the  system 

\ 

(1.1)  i(0  =  (.4  + A^)x(/)  +  Dh'(0,  /e[0,oo),  x(0)  =  0, 

(1.2)  m  =  Ex{t), 

where  x(t)  is  an  «-vector,  AisannXn  matrix  denoting  the  nominal  dynamics  matrix, 
A  A  denotes  an  uncertain  perturbation  of  A  belonging  to  a  specified  set^,  i)w(i).ii  ^for 
now)  a  white  noise  signal  of  intensity  V  A  and  y(/)  is  a  ^-vector  of  outputs.  System 

( 1.1 ),  ( 1.2)  may,  for  example,  denote  a  control  system  in  closed-loop  configuration. 

For  the  system  (1.1)  the  performance  measure  involves  the- steady-state  second 
moment  of  the  outputs  y(0-  In  practice  the  diagonal  elements  of  the  second  moment 
are  measures  of  the  ability  of  the  external  disturbances  Dw{t)  to  excite  specified  states. 
In  the  presence  qf  uncertainties  Ai4,  it  is  of  interest  to  detennine  the  worst-case  steady- 
state  values  of  the  second  moments  of  selected  states.  Thus,  we  define  the  scalar  perfor¬ 
mance  criterion 

(1.3)  y5(^)A  sup  limsupE{y’"(0y(0}, 

I -♦CO 

where  E  denotes  expectation  and  lim  sup  is  a  technicality  to  ensure  that  Js{^)  is  a  well- 
defined  quantity  even  when  A  +  di A  has  eigenvalues  in  the  closed  right  half  plane.  To 
evaluate  (1.3)  define  the  second-moment  matrix 

C(/)AE[x(r)x^(/)], 

which  satisfies  the  Lyapunov  differential  equation 

(1.4)  QUt)  =  iA  +  ^A)Q^At)  +  QMiA  +  ^A)^+V, 
so  that  (1.3)  becomes 

(1.5)  Js(.^)=  sup  lim suptr2i,<(r)i?, 

^Ae-if  (•♦CO 

where  R  A  E^E.  To  guarantee  both  robust  stabiUty  and  performance  we  consider  niodified 
algebraic  Lyapunov  equations  of  the  form 

(1.6)  0=AQ+QA^+il(Q)+V, 


r  •yi^Xt{^'7 
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where  fi(  • )  is  a  matrix  operator  satisfying 

(1.7)  AAQ  +  Q/^A'^^QiQ) 

for  all  AAe<^  and  all  nonnegative-definite  matrices  Q.  The  ordering  in  ( 1.7)  is  defined 
with  respect  to  the  cone  of  nonnegative-definite  matrices.  Our  results  are  based  on  the 
following  robust  stability  and  performance  result  (for  convenience,  assume  that  V  is 
positive  definite).  If  there  exists  a  positive-definite  solution  G  to  ( 1.6),  where  fi(  • )  satisfies 

(1.7) ,  then  ^4  -F  is  asymptotically  stable  for  all  AAe‘^  and,  furthermore, 

(1:8)  Jsi‘'2^)^trQR. 

The  robust  stability  result  is  a  direct  consequence  of  Lyapunov  theory,  while  the  perfor¬ 
mance  bound  (1.8)  follows  from  the  fact  that  since  ^4  +  A/4  is  asymptotically  stable, 
Qax  -  lini,-.co  Qa.<(0  exists,  is  independent  of  Q^a(0),  and  satisfies 

(1.9)  0  =  (A  +  AA)Q^a  +  Q^a(A  +  AA)^+V. 

Now  subtracting  (1.9)  from  (1.6)  yields 

0  =  (A  +  AA)(Q-Q^a)  +  (Q-Q^a)(A  +  AA)^+Q(Q)-(AAQ+QAA^)+V, 
which,  by  ( 1.7)  and  the  fact  that  ^4  +  Av4  is  stable,  implies 

(1.10)  Q^a^Q. 

Now  ( 1.5)  and  (1.10)  yield  the  bound  (1.8). 

Since  the  ordering  induced  by  the  cone  of  nonnegative-definite  matrices  is  only  a 
partial  ordering,  it  should  not  be  expected  that  there  exists  an  operator  fi(  • )  satisfying 

(1.7),  which  is  a  least  upper  bound.  Indeed,  there  are  many  alternative  definitions  for 
the  bound  n(»).  To  illustrate  some  of  these  alternatives,  assume  for  convenience  that 
A.,4  is  of  the  form 

(1.11)  ,  AA  =  <riAi, 

where  <Tt  is  an  uncertain  real  scalar  parameter  assumed  only  to  satisfy  the  stated  bou^s, 
and  /li  is  a  known  matrix  denoting  the  structure  of  the  parametric  uncertainty.  The 
bound  fl(  • )  utilized  in  [9]  and  [12]  for  full-state-feedback  design  was  chosen  to  be 

(1.12)  m)  =  SilAtQ  +  QATl, 

where  |  •  |  denotes  the  nonnegative-definite  matrix  obtained  by  replacing  each  eigenvalue 
by  its  absolute  value.  More  recently,  the  quadratic  (in  Q)  bound 

(1.13)  ii(Q)  =  S,[Ai.Al+QAURQl 

has  been  considered,  where  Ai,,  A/i  are  a  factorization  of  Ai  of  the  form  Ai  =  Ai,Ar. 
Bound  ( 1 . 1 3 )  was  studied  in  [  29  ]  for  robustness  analysis  andin[17],[25],[28],[30j, 
[33],  and  [36]  for  robust  controller  synthesis.  A  third  bound  that  has  also  been  considered 
is  the  linear  (in  Q)  bound 

(1.14)  il(Q)  =  S,laQ+a~'A,QA[], 

where  a  is  an  arbitrary  positive  scalar.  As  shown  in  [33],  bound  (1.14)  arises  from  a 
multiplicative  white  noise  model  with  exponential  disturbance  weighting.  Control-design 
applications  of  bound  (1.14)  are  given  in  [23],  [27],  [33]-[35].  The  principal  contri¬ 
bution  of  the  present  paper  is  thus  a  unified  development  of  bounds  ( 1.12)-(  1.14)  for 
both  robust  stability  and  performance  analysis.  In  addition,  we  present  a  systematic 
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approach  that  pays  careful  attention  to  the  structure  of  the  uncertainty  set  For  example, 
we  show  that  bound  (1.12)  guarantees  stability  over  a  rectangular  uncertainty  set  while 
( 1.14)  is  most  naturally  associated  with  an  ellipsoidal  region.  Furthermore,  to  provide  a 
methodical  development,  we  identify  three  classes  of  bounds  (Types  I,  II,  and  III)  that 
operate  by  exploiting,  respectively,  the  symmetry  of  ^AQ  +  Qbi.A'^y  the  structure  of  Q, 
and  the  structure  of  t^A .  This  approach  clarifies  the  relationships  among  different  bounds 
and  suggests  several  new  bounds.  The  principal  goal  in  this  regard  is  to  demonstrate  the 
richness  of  quadratic  Lyapunov  bounds  to  stimulate  future  developments. 

Finally,  the  presehi  pa^r  also  considers  an  alternative  cost  function^  for  robust 
performance  analysis.  Specifically,  in  place  of  white  noise  disturbances,  we  reinterpret 
wfr)  in  ( 1. 1 )  as  a  deterministic  Li  signal  as  in  theory  [6] .  By  imposing  an  norm 
on  the  output  y(t)  (rather  than  an  L2  norm  as  in  theory),  the  corresponding  per¬ 
formance  measure  is  given  by  (see  [38]) 


.*1 


(1.15)  Jd(^)=  sup  limsupX„„((2A.<(0-R), 


in  contrast  to  (1.5).  Both  performance  measures  /s(^)  and  Joi^)  are  considered  in 
the  paper. 

The  contents  of  the  paper  are  as  follows.  After  summarizing  notation  later  in  this 
section,  the  Robust  Stability  Problem,  Stochastic  Robust  Performance  Problem,  and 
Deterministic  Robust  Performance  Problem  are  introduced  in  §  2.  In  §  3  the  basic  result 
guaranteeing  robust  stability  and  performance  (Theorem  3.1)  is  stated.  This  result  is 
easily  stated  and  forms  the  basis  for  all  later  developments.  A  dual  version  of  Theorem 
3.1  (Theorem  4,1 )  provides  additional  sufficient  conditions  and  clarifies  connections  to 
traditional  robust  stability  results.  The  bound  fl(*)  and  its  dual  A(‘)  are  given  concrete 
forms  in  §  5.  In  §  6,,the  bounds  of  §  5  are  merged  with  Theorem  3.1  to  yield  the  main 
results  guaranteeing  robust  stability  and  performance  (Theorems  6.1-6.5)  via  modified 
Lyapunov  equations.  In  §  7  we  analyze  the  modified  Lyapunov  equations  with  regard 
to  existence,  uniqueness,  and  monotonicity  of  solutions^  Additional  bounds  are  derived 
in  §  8  by  utilizing  a  recursive  substitution  technique,  while  both  upper  and  lower  bounds 
are  obtained  in  §  9.  Finally,  illustrative  examples  are  considered  in  §§  10  and  1 1. 


Notation.  Note:  All  matrices  have  real  entries. 


R,  R'’^^  R",  E 

Ir 

asymptotically 
stable  matrix 


brX  1 


,  expectation. 


real  numbers,  rXs real  matrices, 
r  X  r  identity  matrix, 

matrix  with  eigenvalues  in  open  left  half  plane. 


S' 

rX  r syinmetric matrices. 

w 

rX  r  symmetric  nonnegative-definite  matrices. 

pr 

rX  r  symmetric  positive-definite  matrices, 

Zi  -Z2€N'’,Z,,Z2€S", 

Zi  >  Z2 

Zi  —  Z2  e  P'^,  Zi ,  Z2  € 

trZ,Z^ 

trace  of  Z,  transpose  of  Z, 

MZ) 

eigenvalue  of  matrix  Z, 

Xmix  (Z) 

maximum  eigenvalue  of  matrix  Z  having  real  spectrum. 

il’liz 

Euclidean  vector  norm. 

II -L 

spectral  matrix  norm  (largest  singular  value). 

Hf 

Frobenius  matrix  norm. 

•\ 
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2.  Robust  stability  and  performance  problems.  Let  <2^  <r  denote  a  set  of  per¬ 
turbations  A  A  of  a  given  nominal  dynamics  matrix  ^4  e  Throughout  the  paper  it 

is  assumed  that  ^4  is  asymptotically  stable  and  that  0e‘^.  We  begin  by  considering  the 
question  of  whether  or  not  ^  +  Ay4  is  asymptotically  stable  for  all  AAe‘'I/. 

Robust  Stability  Problem.  Determine  whether  the  linear  system 

(2.1)  x(0  =  (.^  + re[0,oo), 
is  asymptotically  stable  for  all  AAe‘^. 

To  consider  the  problem  of  robust  performance  it  is  necessary  to  introduce  external 
disturbances.  In  this  paper  we  consider  both  stochastic  and  deterministic  disturbance 
models.  The  stochastic  disturbance  model  involves  white  noise  signals  as  in  standard 
LQG  theory,  whereas  the  deterministic  disturbance  model  involves  L2  signals  as  in  /f* 
theory  [6].  By  defining  an  appropriate  performance  measure  for  each  disturbance  class 
it  turns  out  that  we  can  provide  a  simultaneous  treatment  of  both  cases. 

We  first  consider  the  case  of  stochastic  disturbances.  In  this  case  the  robust  perfor¬ 
mance  problem  concerns  the  worst-case  magnitude  of  the  expected  value  of  a  quadratic 
form  involving  outputs  y{t)  =  Exit),  where  E  e  when  the  system  is  subjected  to 
a  standard  white  noise  disturbance  v/{t)  e  R**  with  weighting  D  e  R"^''. 

Stochastic  Robust  Performance  Problem.  For  the  disturbed  linear  system 

(2.2)  x(,t)  =  {A  +  AA)x{t)  +  Dw{t),  /e(0,oo),  x(0)  =  0, 

(2.3)  yit)  =  Exit), 

where  w(  • )  is  a  zero-mean  ^f-dimensional  white  noise  signal  with  intensity  Id,  determine 
a  performance  bound  /Sj  satisfying 

(2.4)  y5(‘2(r)A  sup  limsupE{ll)'(t)lll}g/3s. 

/—oo 

The  system  (2.2),  (2.3)  may  denote,  for  example,  a  control  system  in  closed-loop 
configuration  subjected  to  external  white  noise  disturbances  for  which  y(f)  may  be  the 
state  regulation  error.  Such  specializations  are  not  required  for  this  development,  however. 

Of  course,  since  D  and  E  may  be  rank  deficient,  there  may  be  cases  in  which  a  finite 
jjerformance  bound  ^5  satisfying  (2.4)  exists  while  (2.1 )  is  not  asyniptotically  stable  over 
‘'ll.  In  practice,  however,  robust  performance  is  mainly  of  interest  when  (2.1 )  is  robustly 
stable.  In  this  case  the  performance  /s(^)  is  given  in  terms  of  the  steady-state  second 
moment  of  the  state.  The  following  result  from  linear  system  theory  will  be  useful.  For 
convenience  define  the  «  X  «  nonnegative-definite  matrices 

RAE'^E,  VADD'^. 

Lemma  2. 1 .  Suppose  A  +  AA  is  asymptotically  stable  for  all  AA^'-'H.  Then 

(2.5)  Js("^)=  sup  XxQcaR, 

where  thenX  n  matrix  ‘A.lim,..„  E[x(  0x^(0]  is  given  by 

(2.6)  Q^a=  r dt, 

Jo 

which  is  the  unique,  nonnegative-definite  solution  to 

(2.7)  0  =  {A  +  AA)Q^a  +  Q^a{A  +  AA)^+V. 
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To  State  the  Deterministic  Robust  Performance  Problem  some  additional  notation 
is  required.  For  a  measurable  function  z:  [0,  oo)  -*■  R''  define 

Uco  1 1/2 

which  is  an  function  norm  with  a  Euclidean  spatial  norm,  and  define 

l|z(*)iioo.2^ess.  sup  l|z(/)||2, 

/£[0,ao) 

which  is  an  Z,*  function  norm  with  a  Euclidean  spatial  norm.  We  now  reconsider  (2.2) 
with  w(  • )  interpreted  as  a  square-integrable  function.  In  this  case  the  robust  performance 
problem  concerns  the  worst-case  Xoo  norm  of  the  output  y{t). 

Deterministic  Robust  Performance  Problem  .  For  the  disturbed  linear  system 
(2.2),  (2.3),  where  ||w(')l|2^  g  1,  determine  a  performance  bound  satisfying 

(2.9)  .  sup  sup  !!>'(•)  11^2^ /Sc. 

The  performance  measure  Jd(^)  in  (2.9)  is  given  by  the  following  result. 

Lemma  2.2.  Suppose  A  +  is  asymptotically  stable  for  all  £sAe‘^.  Then 

(2.10)  Zc(‘2r)=  sup  K^{Q^aR), 

&Ae4/ 

where  is  the  unique,  nonnegative-definite  solution  to  (2.7). 

Proof.  The  result  is  an  immediate  consequence  of  Theorem  1  (b)  of  [38].  □ 

Remark  2.1.  Although  and  /^(f/)  arise  from  different  mathematic^  settings 
they  are  quite  similar  in  form.  Note  that  in  general  Js{^)t  and  /d(^)  = 

/5(<>^)ifranki?=  1. 

Remark  2.2.  In  Lemma  2.2  Q^a  can  be  viewed  as  the  controllability  Gramian  for 
the  pair  {A  +  AA,-D)  rather  than  the  state  covariance.  Note  that  Qi^A  is  independent  of 
x(0)and  (2a.i(0). 

Rem(trk2.3.  The-stochastic  performance-measure  /s(^)  given  by  (2:5)  caii  also 
be  written  as 

(2.11)  /5(‘^)=  sup  r\\Ee^'*^‘^'*>‘DUdt, 

iSA'e*  Jo 

which  involves  the  L2  norm  of  the  impulse  response  of  (2.2),  (2.3).  This  stochastic 
performance  measure  can  thus  also  be  given  a  deterministic  interpretation  by  letting 
H'(r)  denote  impulses  at  time  r  =  0.  For  details  of  this  formulation  see  [46,  p.  331]. 

In  the  present  paper  our  approach  is  to  obtain  robust  stability  as  a  consequence  of 
sufficient  conditions  for  robust  performance.  Such  conditions  are  developed  in  the  fol¬ 
lowing  sections. 

3.  Sufficient  conditions  for  robust  stability  and  performance.  The  key  step  in  ob¬ 
taining  robust  stability  and  performance  is  to  bound  the  uncertain  terms  AAQ  +  QAA  ^ 
in  the  Lyapunov  equation  (2.7)  by  means  of  a  function  fi(Q).  The  nonnegative-definite 
solution  Q  of  this  modified  Lyapunov  equation  is  then  guaranteed  to  be  an  upper  bound 
for  The  following  easily  proved  result  is  fundamental  and  forms  the  basis  for  all 
later  developments.  The  result  is  based  on  Lyapunov  function  theory  as  applied  to  linear 
systems.  For  our  purposes,  a  suitable  statement  of  this  result  is  given  by  Lemma  12.2  of 
[39].  Essentially  this  result  states  that  if  the  matrix  equation  0  =  #F+  5’5’’has 

a  solution  FS  0  and  (#,  5')  is  stabilizable,  then  #  is  an  asymptotically  stable  matrix.  Of 
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course,  (#,  5)  is  stabilizable  (regardless  of  4>)  if  5  has  full  row  rank,  and  we  note  (see 
[39,  Thm.  3.6])  that  if  (4>,  S)  is  stabilizable  then  so  is  (#,  [55^  +  ff]  for  all  non- 
negative-definite  matrices  H. 

Theorem  3.1.  le/  fi :  -►  W"  be  such  that 

(3.1)  AAQ+QAA'^^Q{Q),  AAG.m ,  QeN", 
and  suppose  there  exists  Q  e  W"  satisfying 

(3.2)  0=AQ  +  QA^+aiQ)-hV, 

Then 

( 3.3 )  {A  +  AA,D)  is  stabilizable,  AA 
if  and  only  if 

(3.4)  A  +  AA  is  asymptotically  stable,  AAe%. 

In  this  case, 

(3.5)  Q^a^Q,  lAA&m, 
where  Qi^a  s  is  given  by  (2.7),  and 

(3.6)  Jsm^trQR, 

(3.7)  Jorn^K^xm). 

In  addition,  if  there  exists  AA  such  that  [A  +  AA,  D)  is  controllable,  then  Q  is 
positive  definite. 

Proof.  We  stress  that  in  (3.1),  (2  denotes  an  arbitrary  element  of  1^",  whereas  in 
( 3.2 )  2  denotes  a  specific  solution  of  the  modified  Lyapunov  equation.  This  minor  abuse 
of  notation  considerably  simplifies  the  presentation.  Now  note  that  for  all  6 
(3.2)  is  equivalent  to 

(3.8)  0  =  (A  +  AA)Q  +  Q{A  +  AAf+Q(.Q)-(AAQ  +  QAA^)+V. 

Hence,  by  assumption,  (3.8)  has  a  solution  Q  ^  W"  for  all  A/4  eR"^”.  If  AA  is  restricted 
to  the  set  ^ll  then,  by  (3.1),  i2(Q)  -  {AAQ  +  QAA^)  is  nonnegative  definite.  Thus  if 
the  stabilizability  condition  (3.3)  holds  for  all  A  A  e  then  it  follows  from  Theorem 
3.6  of  [39]  that  (A  +  AA,iy+n(Q)-(AAQ  + QAA^)]''^)  is  stabilizable  for  all 
AA  e^.  It  now  follows  from  (3.8)  and  Lemma  12.2  of  [39]  that  A  +  AA  is  asymp¬ 
totically  stable  for  all  AA  e  Conversely,  if  A  +  A  A  is  asymptotically  stable  for  all 
A  A  e  4^,  then  (3.3)  is  immediate.  Next,  subtracting  (2.7)  from  (3.8)  yields 

0  =  {A  +  AA){Q-Q^^)  +  {Q-Q^^KA  +  AAf+Q{Q)-(AAQ+QAA'^),  AAe% 

or,  equivalently,  since  A  +  AA  is  asymptotically  stable  for  all  AA  e  “V/ 

(3.9)  Q-Q:,a=  r e^''-^‘^''^‘lQ{Q)-{AAQ  +  QAA'^)y'**^'*^''‘ dt^O,  AAs^, 

Jo 

which  implies  (3.5).  The  performance  bound  (3.6)  is  now  an  immediate  consequence 
of  (2.5)  and  (3.5).  To  prove  (3.7)  we  note  that  if  O^Afi  ^M2  then  Xm„(Mi)^ 
^m2x  (Ml)  (see,  e.g..  Corollary  7.7.4  of  [40]).  Thus 

Jd(^)=  sup  Xm„((2A/<.R)=  sup  'Kr^KEQc^E'^) 


(3.10) 


^KI.(EQE^)  =  K„{QR). 
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Finally,  it  follows  from  (3.8)  that  if  (A  +  AA,  D)  is  controllable  for  some  AA  e  then 
the  controllability  Gramian  Q  for  the  pair 

{A  +  AA,[V+Q{Q)-{AAQ-^QAA'^)yi^) 

is  positive  definite.  □ 

For  convenience  we  shall  say  that  fi(-)  bounds  ^2^  if  (3.1)  is  satisfied.  To  apply 
Theorem  3.1,  we  first  specify  a  function  Q{‘)  and  an  uncertainty  set  ^  such  that  fi(-) 
bounds If  the  existence  of  a  nonnegative-definite  solution  Q  to  (3.2)  can  be  determined 
analytically  or  numerically  and  (3.3)  is  satisfied,  then  robust  stability  is  guaranteed  and 
the  performance  bounds  (3.6),  (3.7)  can  be  computed.  We  can  then  enlarge  “dt,  modify 
fl(*),  and  again  attempt  to  solve  (3.2).  If,  however,  a  nonnegative-definite  solution  to 
(3.2)  cannot  be  determined,  then  %  must  be  decreased  in  size  until  (3.2)  is  solvable.  For 
example,  n(*)  can  be  replaced  by  cQ(-)  to  bound  where  c  >  1  enlarges  ^  and  c  <  1 
shrinks  Of  course,  the  actual  range  of  uncertainty  that  can  be  bounded  depends  on 
the  nominal  matrix  the  function  and  the  structure  of^.  In  §  5  the  uncertainty 
set  %  and  bound  fl(  • )  satisfying  (3.1)  are  given  concrete  forms.  We  complete  this  section 
with  several  observations. 

Remark  3.1.  If  only  robust  stability  is  of  interest,  then  the  noise  intensity  V  need 
not  have  physical  significance.  In  this  case  we  may  set  P  =  /„  to  satisfy  (3.3). 

Remark  3.2.  Since  A  is  asymptotically  stable,  Q  satisfying  (3.2)  is  given  by 

(3.11)  Q^r e^'mQ)^-  vy‘ dt, 

%/o 

or,  equivalently, 

(3.12)  G=  + 

Jo 

where  Qq  €  W"  is  defined  by 

(3.13)  Co- f  e'^'Ve'*^' dc 

Jo 

and  satisfies 

(3.14)  'o=A(2o  +  QoA^+y. 

Note  that  Co  ^  C  and  that  the  nominal  performances  /s({0})  and  /d({0})  are  given 
by  tr  (2oR  and  An,„  (Co-/?),  respectively. 

Remark  3.3.  Using  (3.1 1)  it  is  also  useful  to  note  that  the  bound  for  Js{‘^)  given 
by  (3.6)  can  be  written  as 


(3.15) 


tr 


e'*‘[il(Q)+  V]e^''‘  dtR  =  tr  Po[fi(C)+  V], 


where  Po  £  N"  is  defined  by 

(3.16)  PoAj\'*''‘Re^' dt 


and  satisfies 
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I  , 

f  ' 

The  bound  tr  Po[fi((2)  +  ^]  can  be  viewed  as  a  dual  formulation  of  the  bound  tr  QR 

since  the  roles  of  A  and  A  are  reversed.  Dual  bounds  are  developed  in  the  following  i  ■ 

section.  Note  that  tr  QoR  =  tT  PoV.  |  ; 

Remark  3.4.  If  fl(*)  bounds  then  clearly  Q(')  bounds  the  convex  hull  of  |, 

Hence,  only  convex  uncertainty  sets  ^  need  be  considered.  Next,  we  shall  later  use  the  j 

obvious  fact  that  if  n'(')  bounds  %'  and  ir(-)  bounds  ‘2'",  then  fi'(-)  +  bounds  i 

Hence  if  ^  can  be  decomposed  additively  then  it  suffices  to  bound  each  com-  | 

ponent  separately.  Finally,  if  n(-)  bounds  ^  and  there  exists  fi' :  ->  M"  such  that 

fi(  2)  ^  J2 '( Q)  for  all  .2  e  N",  then  fi '( • )  also  bounds  That  is,  any  overbound  fl '( ' )  i 

for  fi(  • )  also  bounds  Of  course,  as  we  shall  see,  it  is  quite  possible  that  an  overbound 
fi'(  • )  for  n(  • )  may  actually  bound  a  set  that  is  larger  than  the  “original”  uncertainty 
set  kl. 

4.  Dual  sufficient  conditions  for  robust  stability  and  performance.  As  noted  in  Re¬ 
mark  3.3,  the  performance  bound  tr  QR  ^ven  by  (3.6)  can  be  expressed  equivalently  in 
terms  of  a  dual  variable  Pq  for  which  the  roles  of  A  and  are  reversed.  Using  a  similar 
technique,  additional  conditions  for  robust  stability  and  performance  can  be  obtained 
by  developing  a  dual  version  of  Theorem  3.1.  A  prime  motivation  for  developing  such 
dual  bounds  is  to  draw  connections  with  previous  results  in  the  literature  relating  to 
robust  stability.  Specifically,  we  shall  show  that  traditional  robust  stability  techniques 
based  on  the  quadratic  Lyapunov  function  V{x)  =  correspond  to  dual  conditions. 

Robust  performance  bounds  within  the  dual  formulation,  however,  are  difficult  to  mo¬ 
tivate  without  first  developing  the  primal  performance  bounds  as  was  done  in  the  previous 
section.  In  addition,  the  dual  bounds  may,  for  certain  problems,  yield  larger  stability 
regions  and  sharper  performance  bounds  than  the  primal  bounds. 

Lemma  4.  l .  Suppose  A  +  AA  is  asymptotically  stable  for  all  AA^'dl.  Then 

(4.1)  Js{^)=  sup  trP^^^K, 

<!/<«•*' 

where  P^^a  €  is  the  unique,  nonnegative-definite  solution  to 

(4.2)  Q  =  {.A  +  isAyP:,A  +  P^A(A-i-AA)  +  R. 

Proof.  It  need  only  be  noted  that 

tr  QcaR  =  tr  Te^-^* dtR  =  tr  P^^a V, 

Jo 

where 

P^A^  r  dt 

Jo 


satisfies  (4.2).  □ 

The  proof  of  Lemma  4.1  relies  on  the  fact  thattrQ^^R  =  tr  However, 
it  is  not  necessarily  true  that  ^max(Q^lAP)  =  (Paa^)  even  when  AA  =  0.  For  ex¬ 
ample,  if 


then 


ri  ii  ri  il 

QoR=  ,  ;  and  />oK=  ^  J 

.3  4  J  la  4 . 
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and  thus  {QoR)  =  ( 15  +  Vi45)/24  and  Xn,„  (Po^")  =  (5  +  Vr7)/8.Thus  to  obtain 
a  suitable  dual  version  of  we  need  to  define  a  dual  deterministic  cost 
which  is  distinct  from  This  can  be  done  if  the  disturbance  signals  are  taken  to 

be  integrable  rather  than  square  integrable.  Thus,  for  measurable  z :  [0,  co )  -»”  define 

(4.3)  l|z(-)llu^f  Mt)\\2dt, 

Jo 

which  is  an  L\  function  norm  with  a  Euclidean  spatial  norm.  The  dual  deterministic  cost 
is  thus  defined  by 

(4.4)  sup  sup  ||y(*)lli.2- 

A/Te-iciMOIIuSI 


The  following  dual  result  follows  from  Theorem  1  (a)  of  [38]. 

Lemma  4.2.  Suppose  A  +  AA  is  asymptotically  stable  for  all  AAe<^.  Then 

(4.5)  Som  Xmax  {P^aV), 

where  e  R"^"  is  the  unique,  nonnegative-definite  solution  to  (4.2). 

The  dual  version  of  Theorem  3.1  can  now  be  stated. 

Theorem  4.1.  Let  A -M"-*  W"  be  such  that 


(4.6)  .  AA'^P+PAA^A{P),  AA&^,  PeW, 


and  suppose  there  exists  P  €  W"  satisfying 

(4.7)  0=.4^P+P^  +  A(P)+P. 

Then 


(4.8) 

if  and  only  if 

(4.9) 

In  this  case, 

(4.10) 


{E,A  +  AA)is  detectable,  AA 
A  +  AA  is  asymptotically  stable,  AA 
PcA^P,  AA&<^, 


where  P^a  is  given  by  (4.2),  and 

(4.11)  Js{^)%\rPV, 

(4.12)  /n("^)gX„„(Pn. 

In  addition,  if  there  exists  AA  such  that  {E,  A  +  AA)  is  observable,  then  Pis  positive 

definite. 

Proof.  The  proof  is  completely  analogous  to  the  proof  of  Theorem  3.1.  □ 

Remark  4.1.  Note  that  Joi'^'l^)  ^  and  that  JoifiH)  =  Tsifd)  if  rank  F  =  1. 
Combining  this  fact  with  Remark  2.1,  it  follows  that  /o(‘2^)  =  Joifl^)  if  both  rank  R  =  1 
and  rank  F  =  1.  In  general,  however,  we  should  not  expect  that  Joifid)  =  ioifl^)- 

It  is  quite  possible  that  the  bounds  tr  QR  and  tr  PF  for  Js(^)  ^ven  by  (3.6)  and 
(4.1 1)  may  be  different  in  spite  of  the  fact,  as  shown  in  the  proof  of  Lemma  4.1, 
thattrQAxP  =  trP^^F.  That  is,  depending  on  n(-)  and  A(-)  either  bound  (3.6)  or 
bound  (4.1 1 )  may  be  better  for  a  particular  problem.  In  general,  we  have  the  following 
result. 
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Proposition  4.1.  Let  fi(-),  A(-),  Q»  and  P  be  as  in  Theorems  3.1  and  4.1,  and  let 
Qo  and  Pq  be  given  (3.13)  and  (3.16),  respectively.  Then 


(4.13) 

tr  QoAiP)  <  tr  Po9i  Q)otTQR>ti  PV, 

(4.14) 

tr  QoAiP)  =  tr  PoQiQ)oU:  QR  =  Xi  PV, 

(4.15) 

tT  QoAiP)>ti  Po^iQ)otr QR<ts PV. 

Proof  Note  that 

and 

tr  QR  =  £ e^‘[ttiQ)  +  V]e^^‘  dt  R  =  tr  Pofi(G) +tr  J 

e^‘Ve*^‘ dtR 

0 

f® 

f“  7- 

trPV=tT  e^'[A(R)-FR]e^'d/F=tr<2oA(P)+tr 

JO  >1 

&*‘Re^‘dtV 

'0 

so  that 

tr  PV=\x  Po9.{Q)-trQaMiP), 
which  yields  (4.13)-(4.15).  □ 

Remark  4.2.  To  draw  connections  with  traditional  Lyapunov  theory,  let  R  and  V 
be  positive  definite  and  assume  that  there  exbts  a  positive-definite  solution  to  (4.7). 
Then  V(x)  ^  x^Px  satisfies  Vlx{t))  <  0  for  x(~)  satisfying  (2.1 )  and  for  all  e 
Thus  P'(-)  is  a  Lyapunov  function  for  (2.1)  that  guarantees  robust  asymptotic  stability 
over  ‘i/. 


5.  Construction  ofthe  bounds  Q(-)  and  A(-).  As  discussed  in  §  1,  we  consider  three 
distinct  classes  of  bounds  fl(  • )  denoted  by  Type  I,  Type  11,  and  Type  III.  Roughly  spealdng, 
these  bounds  exploit,  respectively,  the  symmetry  of  the  Lyapunov  terras  AAQ-r  QAA 
the  structure  of  Q,  and  the  structure  of  ^A.  The  dual  bounds  A(*)  can  be  constructed 
similarly  by  replacing  Q  and  A  A  by  Rand  A  A  Hence  these  bounds  will  not  be  discussed 
separately.  For  convenience  in  discussing  the  set  *2^,  we  shall  use  the  terms  rectangle  and 
ellipse  to  refer  to  closed  regions  bounded  by  such  figures  in  multiple  dimensions.  As 
usual,  a  polytope  is  the  convex  hull  of  a  finite  number  of  points. 

5.1.  Type  I  bounds.  We  begin  by  constructing  bounds  fi(')  that  exploit  only  the 
symmetry  of  the  Lyapunov  terras  i^AQ  +  QAA^.  Rrst  we  require  the  following  well- 
known  definition  of  a  function  of  a  symmetric  matrix  as  an  extension  of  a  real-valued 
function  (see,  c.g.,  [40,  p.  300]).  Specifically,  if/:  R  -►  R,  then  (with  a  minor  abuse  of 
notation) /:  S"  -*■  S"  can  be  defined  by  setting 

nS)AUf{D)U\ 

where  S  =  UDU^,  U  is  orthogonal,  D  is  real  diagonal,  and /( D)  is  the  diagonal  matrix 
obtained  by  applying  /  to  each  diagonal  element  ofi?.  Note  that  if  /is  the  polynomial 
fix)  =  2/-0  aix‘  then  /(S)  =  2/-o  0,5'.  Note  also  that  if  fix)  =  |.rj  then  /(S)  = 
(5^)"*,  where  (O'^^  denotes  the  (unique)  nonnegative-definite  square  root  As  in  (41, 
p.  262],  we  use  the  notation  |  S|  to  denote  (5*)"^.  Finally,  note  that  if/:  R  R  and 
g:  R  -*■  R  are  such  that  fix)  ^  g(.x),  x  e  R,  ihen/(5)  S  giS),  S  €  S". 

As  a  concretization  of  the  uncertainty  set  consider  the  set 

‘2^,a|a;4€R'”‘":A/1=  2  k,|  ^5„/=  I,  ,p|. 


(5.1) 
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where,  for  i  =  I, ,p:  Ate  is  a  given  matrix  denoting  the  structure  of  the  para¬ 
metric  uncertainty,  at  is  a  real  uncertain  parameter,  and  5,  denotes  the  range  of  parameter 
uncertainty.  Clearly,  the  multidi-:.ensional  set  of  uncertain  parameters  (o-i,  •  •  •  ,  Cp)  is 
the  rectan^e  [-oi,  5il  v  •  X  [-6p,  5p]  and  is  a  symmetric  polytope  of  matrices 
in  Note  mat  the  symmetry  of  the  uncertainty  interval  [-5,,  5/]  entails  no  loss  of 
generality  since  the  nominal  value  o^A  can  be  redefined  if  necessary.  Furthermore,  it  is 
also  possible  without  loss  of  generality,  to  define  6/  =  1  by  replacing  Ai  by  diAi.  For 
clarity,  ho  .jver,  we  choose  not  to  employ  this  scaling.  We  begin  by  considering  the 
bound  utilized  by  Chang  and  Peng  in  (9].. 

Proposition  5.1.  The  function 

(5.2)  ildQ)^i5,\A,Q  +  QAT\ 

i- 1 


bounds  ^1l\. 

.  Proof.  For  /  =  1,  •  •  • ,  p  and  1  ff/1  ^  5,-, 

a,{AiQ+QAj)^ \<riiAiQ+QAT)\  =  \ci\\AtQ  +  QAT\ ^8i\AiQ  +  QAT\. 


Summing  over  i  yields 

AAQ+QAA'^=  t  ffiiAiQ  +  QAf)^  2  dilAiQ  +  QAll, 

/-I  /-I 


which  implies  (3.1)  with  fi(*)  =  ftiO)  and  □ 

Remark  5.1.  It  is  tempting.to  prove  Proposition  5.1  by  writing 


2 


ndAiQ^QAj)^ 


2 


rrAAiQ^mf^ 


^2 


i- I 


/- 1 


/-I 


\<r.(AtQ  +  QAr)\. 


However,  counterexamples  show  that  the  inequality  |Mi  +3/2I  g  \M\  \  +  IA/2I  is  not 
generally  true  for  arbitrary  symmetric  matrices  Af  1 ,  M2 . 

Remark  5.2.  Because  of  its  simplicity  it  is  tempting  to  conjecture  that  ni(-)  is  the 
best  bound  for  AAQ  +  QA/4^  over  the  set  ‘'^i.  To  show  that  this  is  not  the  case,  let 
(2  =  i/2.;»=  1,^1  =[o-i],and6,  =  l.Then  <rdAiQ  +  QAf)  ^  5dAiQ  +  QAl\  =  h, 
1  o"!  I  ^T.  However,  it  is  also  tiue  that 


<rdA,Q+QAh^ 


Neither  bound,  however,  is  an  orerbound  for  the  other.  This  is  a  consequence  of  the  fact 
that  the  nonnegative-definitc  matrix  ordering  is  only  a  partial  order. 

As  mentioned  earlier,  an  overbound  for  ni(-)  will  also  bound  The  following 
result  is  immediate. 

Lemma  5.1.  For  /  =.  I,  •  •  •  ,  p,  let  f:U-*U  satisfy 
(5.3:  y/(A-)^lx|,  ;c€R. 

Then  the  function 

(.5.4)  MQ)^Y.hfi{AiQ  +  QAj) 

/-  1 


is  on  overbound  forU\i-)  and  hence  also  bounds  %  i . 


( V*  ..-C  ."<^<Ur/»- 
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One  particular  choice  of  yj  satisfying  (5.3)  will  be  considered  here,  namely, 
the  polynomial 

(5.5)  f,{x)=k^i+^T'x\ 

where  j3j  is  an  arbitrary  positive  constant.  Thus  Qii')  has  the  following  specialization. 
Corollary  5.1.  Letfii,  •"  ,fipbe  arbitrary  positive  constants .  Then  the  function 


fl3(Q)^7  i  Wn+ 
4/-I 


Hi) 


(AiQ  +  QATf 


is  an  overbound ybr  fii  (•)  and  hence  also  bounds  . 

Although  overbounding  fii(')  by  fi3(*)  results  in  a  looser  bound  for  it  turns 
out  that  fl3(*)  actually  bounds  a  set  that  is  larger  than  <2^1 .  Specifically,  in  place  of 
'dlx  consider 

(5.7)  ‘2^2^(a.4€R'"'":A^=  2  M/, 

I  /-I  /-!«' 

where  ai,  •  •  • ,  Op  are  given  positive  constants.  Note  that  (5.7)  replaces  the  rectangle  of 
uncertain  parameters  ( <;i ,  •  •  •  ,  <rp)  by  an  ellipse.  Thus  the  set  ^2  of  matrix  perturbations 
is  an  ellipse  of  matrices  in  in  contrast  to  the  polytope  Of  course,  if 

p  =  1  and  ai  =  5i .  Again  it  is  possible  to  take  «/  =  1  without  loss  of  generality  by  replacing 
Ai  by  a,Ai.  We  again  choose  not  to  do  this,  however.  The  following  result  provides 
a  convenient  characterization  of  the  relationship  between  the  rectangle  ‘2/ 1  and  the 
ellipse ‘2^2  • 

Proposition  5.2.  Suppose  is  defined  by  the  positive  constants  5i ,  •  •  • ,  6p,  and 
let  ^2  be  characterized  by 


a.-  ,  I 


where  a  is  defined  by 


a  =  2  5,/3/ 


and  /3i ,  •  •  •  ,  jSp  are  arbitrary  positive  constants.  Then  the  ellipse 

(ffi,  ,ffp):  2^^l| 

/-I®^  J 

circumscribes  the  rectangle  { ( o-i ,  •  •  • ,  ffp);  |  <r,  |  ^di,i=  1 ,  •  •  ■  ,  p }  and  thus  ^ 2  contains 
‘>11  Furthermore,  9.i{-)  actually  bounds ‘^z- 

Proof.  If  k/l  ^di,i=  1,  •  •  •  ,p,  then  it  follows  from  (5.8)  and  (5.9)  that 


V  -1  V  -'V  ^  -  1 

2-2  =  “  2-r-^a  2  .■5,=  i. 


%><•? 


-t  >X*  .?  I*- .M*  • 


w 
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Thus  the  ellipse  contains  the  rectangle.  If,  in  addition,  (cri,  •••,  <rp)  is  a  vertex  of  the 
rectangle,  i.e.,  l<r;|  =  5,-,  /  =  I,  •  •  • ,  p,  then  2/- 1  <r^/af  =  1,  which  corresponds  to  a 
point  on  the  boundary  of  the  ellipse.  To  show  that  Slji')  actually  bounds  ^2  note  that 

=  7  i  +  2  ahAiQ+QAD^-iAAQ  +  QAA^). 

Since  2?- 1  (rf/af  ^  1  in  ‘2^2.  it  follows  that 

AAQ+QAA^^jI„+a-'  2  ahAiQ  +  QAff. 

Utilizing  (5.8)  and  (5.9)  to  substitute  for  a  and  a,-  yields  (3.1)  with  fi(')  =  i23(')  and 

m  =  ^2-  □ 

Proposition  5.2  shows  that  each  choice  of  constants  jSi,  •  •  •  ,  jSp  >  0  leads  to  a 
particular  ellipse  ^2  that  contains  the  polytope  ^  1 .  Furthermore,  which  by  Cot¬ 
ollary  5. 1  bounds  ‘^Ux ,  actually  bounds  the  larger  set  ^2-  For  convenience,  we  now  dispense 
with  the  constants  i3i,  •  •  • ,  /3p  that  relate  the  rectangle  <2^1  to  the  ellipse  ^2^2  and  we 
characterize  fl3(-)  entirely  in  terms  of  a,  a, ,  •  •  ■  ,  Up. 

Corollary  5.2.  Let  a  be  an  arbitrary  positive  constant.  Then  the  function 


(5.10) 


%{Q)^-rIn+cc-'  2  ahAiQ  +  QAlf 

^  i- 1 


bounds ‘^z- 

Remark  5.3.  Within  the  context  of  Corollary  5.2,  the  positive  constant  a  plays  no 
role  in  defining  the  set  *2^2 » although  fi4(')  is  guaranteed  to  bound  ^2  for  all  choices  of 
a.  It  can  be  expected,  however,  that  certain  choices  of  a  provide  better  bounds  than  other 
choices.  This  will  be  seen  by  example  in  §  10. 

The  following  variation  of  ft4(-)  was  suggested  by  D.  C.  Hyland. 

Proposition  5.3.  Let  a  be  an  arbitrary, positive  constant.  Then,  for  Q  >  0, 

(5.10)'  fi4'(Q)^7Q+V  2  oc}[AlQ+A,QAT+QAiQ-UiQ  +  QAV] 

bounds 2. 

Proof.  Note  that 

=  7  i  i  aHA,Q+QAT)Q-'{AiQ  +  QAT)-{AAQ  +  QAA^), 

which  yields  the  desired  result.  □ 

Remark  5.4.  The  bound  itiAQ)  is  of  interest  since  it  involves  terms  that  arise  from 
a  multiplicative  white  noise  model  with  a  Stratonovich  correction.  Specifically,  the  term 
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AiQAf  arises  from  an  Ito  model  [33],  whereas  the  terms  A}Q  and  QA}^  can  be  viewed 
as  the  shift  A-*-A  +  due  to  the  Stratonovich  interpretation  of  stochastic  in¬ 

tegration  [43].  These  terms  have  interesting  ramifications  in  designing  controllers  for 
flexible  structures  [23]. 

5.2.  Type  11  bounds.  We  now  consider  additional  bounds  for  ^  that  exploit  the 
structure  of  Q.  For  these  bounds  the  natural  uncertainty  set  is  given  by  ^2. 

Proposition  5.4.  Let  a  be  an  arbitrary  positive  number  and,  for  each  Q  e  PJ",  let 
Q\  e  and  Qz  e  R."^"  satisfy 


(5.11) 

Then  the  function 

Q=QiQ2. 

(5.12) 

^5{Q)^aQlQ2  +  a-^  2  aUiQiQUT 

i-  1 

bounds  ^2- 

Proof.  Note  that 

-  T 

]qIQ2+c^-'  2  ‘^UiQiQUT-  2  ciiAiQ+QAf), 

/  /-I  /-I 

which,  since  2?- 1  <r</a?  ^  1,  yields  (3.1 )  with  n(-)  =  fi5(-)  and  =  ‘^2-  □ 

We  consider  three  specializations  of  Qj(0-  Specifically,  we  set  w  =  rt  and  define 

(5.13) 

Ql-Qt  Q2-In> 

(5.14) 

(5.15) 

Q2-Q- 

Corollary  5.3. 

Let  a  be  an  arbitrary  positive  number.  Then  the  functions 

(5.16) 

fi6(Q)-«/n  +  a"‘  2  (xJAiQ^aT, 

i- I 

(5.17) 

U2{Q)&aQ  +  a~'  2  (xjAtQAT, 

i-  1 

(5.18) 

Qs{Q)^aQ^  +  a~'  2  cejAiAf 
i~  1 

bound ‘'ll 2. 

Remark  5.5.  Note  that  the  term  A,Q^A[ appearing  in  Q6(’)  also  appears  in  Si4(-). 
Furtheraiore,  both  n4(*)  and  involve  a  term  proportional  to  I„.  Despite  these 
similarities,  neither  bound  n4(-)  nor  is  an  overbound  for  the  other.  Furthermore, 
the  term  A,QAj appears  in  both  Qz{-)  and  ^4  (•).  However,  neither  nor  is 
an  overbound  for  the  other. 

Remark  5.6.  The  bound  07(-)  given  by  (5.17)  has  t’  tinction  that  it  is  linear 
in  Q.  This  bound  was  originally  studied  in  [27]  for  syste  with  multiplicative  white 
noise  and  v/as  shown  to  yield  robust  stability  and  f  mance  in  [33]  and  [35].  A 
similar  bound  was  studied  in  [34]. 
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Remark  5.7.  By  using  (5.11)  additional  bounds  can  be  developed.  For  example, 
by  setting 

(5.19)  Gi  =  <2‘^  Q2  =  Q^^\ 

Qi(-)  becomes 

(5.20)  Q9iQ)  =  aQ^'^  +  a-' iaUiO'^W. 

/-I 

Remark  5.8.  When  p  =  1  and  a  is  replaced  by  aai,  n7(*)  becomes 
Qi(Q)  =  cci[aQ  +  a~'  AiQAl]. 

A  sum  of  such  terms  with  «/  =  5;  can  be  used  to  bound  the  smaller  rectangular  set  . 
Similar  remarks  apply  to  fl6(').  iJ8(').  and 

5 Type  III  bounds.  We  now  consider  bounds  that  exploit  the  structure  of  AA 
itself.  It  turns  out  that  these  bounds  permit  consideration  of  an  uncertainty  set  ^  that 
is  larger  than  4!^2-  Specifically,  define 

(5.21)  ^3A{AAeU">^'’:AA=ALAR,ALAl^M,AURSN}, 

where  Al  €  and  Ar,^  are  uncertain  matrices,  r  is  an  arbitrary  positive  integer, 
and  Af,  N  €  are  given  uncertainty  bounds.  The  bound  nio(')  for  ^3  is  given  by  the 
following  result. 

Proposition  5.5.  Let  a  be  an  arbitrary  positive  constant.  Then  the  function 

(5.22)  Q,o(Q)Aa-‘M+aQ!^Q 

bounds'll. 

Proof.  Note  that 

Q^[a''''^AL-a^'^QAl][a-''^AL-ct''^QAlY 

=  a  ■  *  AiA  I  +  aQA  rArQ  —  [Ai,ArQ  +  Q(Ai,.4r)^] 

^a-'M+aQNQ-(AAQ  +  QAA^), 

which  yields  (3.1 )  with  Q(-)  =  flio(‘)  and  =  ‘7/3.  □ 

Remark  5.9.  The  bound  fiio(0  was  developed  in  [29]  for  robust  analysis  and  in¬ 
dependently  in  [25]  and  [28]  for  robust  full-state  feedback.  Applications  to  fixed-order 
dynamic  compensation  are  given  in  [36]. 

Remark  5. 10.  Without  loss  of  generality  we  can  set  a  =  1  in  (5.22)  by  replacing  M 
and  by  a"' AT  and  aN,  respectively.  Again  for  clarity  we  choose  not  to  employ  this 
scaling. 

Note  that  12g(-)  is  of  the  form  nio(')  with  M  =  2?- 1  cc}A,AJ  and  N  =  Thus 
%(•)  also  bounds  <2^3  for  this  choice  of  M  and  N.  It  turns  out  in  this  case  that  <5^3  is 
actually  larger  than  45^2.  To  see  this  consider  the  more  general  case  in  which  M  and 
AT  satisfy 

(5.23)  j^aUiAf^M,  I„^N. 

I- 1 

In  this  case  fi)o( • )  is  an  overbound  for  Qs(‘)  and  thus  bounds  ^2.  As  in  the  case  of  fi3( • ) 
overbounding  52i(-).  we  should  not  be  surprised  to  find  that  nio(0  with  (5.23)  actually 
bounds  a  set  that  is  larger  than  ‘2^2-  Indeed,  we  now  show  that  <^2  is  actually  a  very  special 
subset  of  when  A/ and  A/^ defining  <2^2  satisfy  (5.23). 
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Proposition  5.6.  If  M and N satisfy  (5.23)  then  ^2  is  a  subset  of‘^2.  Hence  fiio(  • ) 
also  bounds ‘dll. 

Proof.  If  tsA  e  ‘dli  then  AA  =  Zf- 1  (TiAi,  where  Z f- 1  <rj/a}  ^  1.  Alternatively,  we 
can  write  AA  =  AlAr,  where  r~pn  and 


(5.24) 


AL=[atAi-'‘apAp], 


Ar  — 


(<ri/oci)I„ 


L  (  ^p)In  J 


Note  that  with  M  and  satisfying  (5.23)  and  Al  and  Ar  defined  by  (5.24),  it  follows 
XheX  AiAl,^  M and  A rAr  ^  N.Thus  AA  £‘21^.  □ 

The  following  result  provides  further  conditions  under  which  fiioCO  bounds  ‘^li. 
Proposition  5.7.  Suppose  Ai  =  DiEi,  i  =  I,  •  “  ,  p,  where  Di  e  02"^"'  and  Ei  6 
gjn/Xn^  suppose  that 

(5.25)  i  ajDiDf^M,  2  EjEi^N. 

1-1  ;-i 

Then  “Hi  is  a  subset  of‘dli  and  thus  flio(‘)  also  bounds  ‘dli. 

Proof.  The  result  follows  as  in  the  proof  Proposition  5.6.  □ 

Remark  5.1 1.  When  p=  {,A\  =  D\E\,M  =  a\DiDj,  and  N  =  EJE\,  it  is  con¬ 
venient  to  replace  a  by  aui  so  that  I2io(')  becomes 

(5.26)  a,0'(Q)  =  ai  [«-'  D^DT+  aQElEtQ: 


In  certain  situations  it  is  desirable  to  consider  subsets  of'dli  of  special  structure.  For 
example,  define 

oU^A{AAQR’'^''-.AA  =  DoALARE^,\\Ads^^,\\AR\\s^\}, 

where  Do  e  and  Eo  e  are  known  matrices  denoting  the  structure  of  the 
uncertainty,  and  Al  e  R"'  and  Ar  e  R'’^"^  are  uncertain  matrices  [28].  Finer  structure 
can  be  included  vrithin  dl^  by  replacing  DqMNEo  by  a  sum  of  terms  DiM,NiEi,  where 
D„  E,  are  known  and  M,,  N,  are  uncertain  [36].  Note,  however,  that  even  though  dl^  is 
a  proper  subset  oldlj,  the form  of  the  bound  fiio(  • )  does  not  change.  Thus  such  refinements 
render  the  bound  fiio(‘)  conservative  with  respect  to  “Jin  since  the  larger  uncertainty  set 
“III  is  actually  being  bounded. 

6.  Robust  stability  and  performance  via  modified  Lyapunov  equations.  We  now 
combine  the  principal  results  of  §§  3, 4,  and  5  to  obtain  a  series  of  conditions  guaranteeing 
robust  stability  and  performance.  In  particular,  we  focus  on  bounds  and 

fiio.  For  simplicity  we  shall  frequently  assume  that  Fis  positive  definite  so  that  (3.3)  is 
satisfied.  In  this  case  it  follows  that  the  solution  Q  of  (3.2)  is  positive  definite.  Our  first 
result  is  a  corollary  ofTheorem  3.1  with  fi(-)  =  fi|(-)  and  “11  =  “ll\. 

Theorem  6.1.  Let  VeP",  ,  5p>  0,  and  suppose  there  exists  QeP”  satisfying 

(MLEl)  0  =  AQ  +  QA^+i  bi\AiQ  +  QAj\^-V. 


Then  A  +  AA  is  asymptotically  stable  for  all  AAedl^  and 

(6.1)  Jsldli)^tTQR, 

(6.2)  JD{“JJi)^>^n,.AQR). 
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For  the  next  result  define 


(6.3) 


Aa  —  A+—In 


and 

(6.4) 


7/-—. 

or 


/=  1,  •••  ,p. 


Setting  S2(-)  =  fi4(-).  fl6(*).  ^^7(0  and  ‘’ll  =  yields  the  following  corollary  of  Theo¬ 
rem  3.1. 

Theorem  6.2.  Let  V g  P",  a,  ai,  •  ■  • ,  Up  >  0,  and  suppose  there  exists  QeP" 
satisfying  either 

(MLE2)  0  =  AQ+QA^+  2  yi{AiQ+QATf+~l„+V, 

/-I  4 

(MLE3)  0  =  AQ+QA'^-i-  2  yiAiQW+aI„+  V, 

i-  1 


or 

(MLE4)  0  =  AM+QAI+  2  y,AiQAT+V. 

/- 1 

Then  A  +  AA  is  asymptotically  stable  for  all  A/4  e  ^2.  and 

(6.5)  Js{‘’U2)^xr  QR,  > 

(6.6)  W2)SX„„(Q?.). 

Next  we  set  fi(')  =  fiio(-)  and  dl  =  ‘lli. 

Theorem  6.3.  Let  FeP",  a>  0,  and  and  suppose  there  exists 

QeP"  satisfying 

(MLE5)  0=AQ+QA^+aQNQ  +  a-'M+V. 

Then  A  +  AA  is  asymptotically  stable  for  all  A  A  e  ^^3,  and 

(6.7)  W3)^trG/?, 

(6.8)  •  Joi'dlj)^ 

^max  iQR). 

Remark  6.1.  Note  that  ( MLE5 )  is  a  Riccati  equation.  This  is  precisely  the  equation 
studied  in  [29]. 

Additional  sufficient  conditions  can  be  obtained  by  considering  “mixed”  bounds. 
That  is,  we  can  construct  modified  Lyapunov  equations  by  combining  two  or  more 
different  bounds.  Although  mixed  bounds  will  not  be  considered  furthv.r  in  this  paper, 
we  present  one  such  result  for  illustrative  purposes. 

Theorem  6.4.  Let  V  eP",  a,  ,  5p>  0,  M  e  1^",  and  N  e  W,  and  suppose 
there  exists  QeP"  satisfying 


(MLE1,5)  0=AQ+QA^+  2  6ilA,Q+QAri+aQNQ+a-'M+y. 
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Then  A  +  LA  is  asymptotically  stable  for  all  €  ^/i  +  <2^3,  and 

(6.9)  75(^i+^3)^tr(2i?, 

(6.10)  W.+<?!^3)^Xm«((2/?). 

As  noted  previously,  the  bound  A(*)  can  readily  be  constructed  by  replacing  A  A  by 
AA^in  the  definitions  of  ni(‘)  through  flio(')*  Denote  these  bounds  by  Ai(')  through 
Aio(*)>  respectively.  For  illustration  we  state  the  dual  of  Theorem  6.1  involving  Ai(*). 
The  dual  versions  of  (MLEl  )-(MLE5)  will  be  denoted  by  (MLEDl  )-(MLED5). 
Theorem6.5.  LetJteP'',di,  ••• ,  hp>Q,  and  suppose  there  exists  P&P"  satisfying 

(MLEDl)  0=A'^P+PA+  i  Si\ATP+PA[\  +.R. 

I- 1 

Then  A  +  AA  is  asymptotically  stable  for  all  AA&^i,  and 

(6.11)  Js{‘^y)^\X  PV, 

(6.12)  jD(^.)^Xn,„(m 

It  is  reasonable  to  expect  that  the  sufficient  conditions  given  by  Theorems  3.1  and 
4.1  are  generally  different.  For  example,  the  modified  Lyapunov  equations  and  their 
duals  need  not  both  possess  a  solution,  while  the  bounds  tr  QR  and  tr  PV  need  not  be 
equal.  An  exception  is  the  case  in  which  !!(•)  =  fl7(*)  and  A(-)  =  A7(-)>  Note  that  the 
dual  of  (MLE4)  is  given  by 

p 

(MLED4)  0=AlP+PAa+  2  yiAfPAi^  V. 

i- 1 

Proposition  6.1.  Leta,ai,  •"  ,ap>Q  and  assume  there  exist  Q,  F  e  RJ"  satisfying 
(MLE4)  a/jif  (MLED4).  Then 

(6.13)  tr(2i?  =  trFF. 

Proof  Note  that 

tr  QR  =  -tr  qI^AIP+PA^-^  2  yiAfPA,^ 

=  -tr  pi^AM  +  QAl+  2  yiAiQAT^ 

=  trPV.  □ 

Remark  6.2.  By  setting  fi(-)  =  %{•)  and  A(-)  =  A^(■)  it  follows  from  (4.14)  that 

(6.14)  trQol^aP+ZyiArPA,j  =  trPo(^aQ+iyiAiQAT'j. 

7.  Existence,  uniqueness,  and  monotonicity  of  solutions  to  the  modified  Lyapunov 
equations.  It  is  important  to  stress  that  the  sufficient  conditions  for  robustness  given  by 
Theorems  6. 1-6.5  assume  only  that  there  exist  nonnegative-definite  solutions  Q,  Psat- 
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isfying  the  mcxiified  Lyapunov  equations.  Indeed,  no  explicit  assumptions  on  the  problem 
data  A,  V,  R,  and  "2l  were  utilized  for  assuring  robust  stability  and  performance.  In 
applyingTheorems  6. 1  -6.5  to  specific  problems  it  thus  suffices  to  show  that  a  nonnegative- 
definite  solution  Q  exists  in  order  to  obtain  robust  stability,  while,  for  robust  performance, 
the  bounds  (6.1),  (6.2),  (6.5)-(6.8)  require  explicit  knowledge  of  Q.  Thus,  any  com¬ 
putational  method  that  yields  a  nonnegative-definite  solution  will  suffice  to  guarantee 
both  robust  stability  and  performance. 

Before  considering  the  numerical  solution  of  the  modified  Lyapunov  equations, 
several  relevant  issues  require  discussion.  For  example,  before  seeking  to  compute  solutions 
to  ( MLE 1 )  -  ( MLE5 )  it  would  be  desirable  to  determine  a  priori  whether  these  equations 
actually  possess  nonnegative-definite  solutions.  For  example,  it  may  be  useful  to  obtain 
sufficient  and/or  necessary  conditions  for  the  existence  of  nonnegative-definite  solutions. 
Thus,  if  the  sufficient  conditions  are  satisfied  then  existence  (and  hence  robustness)  is 
assured,  whereas  if  the  necessary  conditions  are  not  satisfied  then  existence  is  ruled  out. 
If,  on  the  other  hand,  either  the  sufficient  conditions  are  not  satisfied  or  the  necessary 
conditions  are  satisfied,  then  nothing  can  be  surmised.  Finally,  such  conditions  need  to 
be  easily  verifiable  and  reasonably  nonconservative  since  otherwise  it  would  be  more 
prudent  to  attempt  to  numerically  solve  the  modified  Lyapunov  equations  themselves. 

It  is  quite  possible  that  at  least  some  of  the  modified  Lyapunov -equations  possess 
multiple  nonnegative-definite  solutions.  In  this  case  we  may  seek  the  minimal  solution 
(i.e.,  the  smallest  with  respect  to  the  nonnegative-definite  matrix  ordering)  to  minimize 
the  performance  bounds.  If  multiple  solutions  exist,  none  of  which  is  minimal,  then  the 
best  bound  would  depend  on  the  matrix  R. 

Since  the  matrix  Q  determines  the  performance  bound,  it  is  reasonable  to  expect  Q 
to  be  monotonic  in  -ii.  That  is,  if  decreases  in  size,  then  the  solution  Q  is  more  likely 
to  exist  while  decreasing  in  the  nonnegative-definite  matrix  ordering.  For  example, 
consider  <>U\  characterized  by  h',,  where  5/  ^  5;,  /  =  1,  •  •  • ,  p.  Then  we  might  expect 
Q'  ^  Q,  where  Q  is  the  solution  to  (MLEl )  with  5,  replaced  by  5',.  Finally,  monotonicity 
with  respect  to  V  should  also  be  expected.  Because  of  linearity,  the  analysis  of  bound 
fi7(-)  is  simplest  and  it  is  possible  to  obtain  necessary  and  sufficient  conditions  for  the 
existence  of  solutions  to  (MLE4).  The  basic  tool  required  is  the  Kronecker  matrix  algebra 
[42].  For  convenience,  define  » 

(7.1)  s/&AaeA„+  2  yiAi®Ai, 

i- I 

where  ©  denotes  the  Kronecker  product  and  A„QAa^Aa®I„  +  In®  A„  is  the  Kro¬ 
necker  sum. 

Proposition  7.1.  IfVeW  and  sJ  is  asymptotically  stable,  then  there  exists  a 
unique  QeU"^  "  satisfying  {M.LE4),  andQ'^0.  Conversely,  ifforall  there  exists 
Q  §  0  satisfying  {MLE4),  then  sJ  is  asymptotically  stable. 

Proof.  Since  (MLE4)  is  equivalent  to 

(7.2)  0  =  — vec"' [x/”‘ vec  K], 

existence  and  uniqueness  hold.  Here,  vec  and  vec”'  denote  the  column-stacking  operation 
[42]  and  its  inverse.  To  prove  that  Q  is  nonnegative  definite,  we  rewrite  (7.2)  as 


vec"'  [e”^’  vec  V]  dt 
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and  show  that  the  integrand  is  nonnegative-definite  for  all  t  e  [0,  oo).  (Note  that  the 
following  argument  for  fixed  /  S  o  does  not  require  that  jj/  be  stable.)  Using  the  exponential 
product  formula, '  the  exponential  in  (7.3)  can  be  written  as 


(7.4) 


e-”"=  lira 

CO 


exp 


bl 


\{A„QAa)t  I  exp  1 7  2  yi{Ai(S>A{)t 


For  convenience,  let  5  and  AT  be  r  X  r  matrices  with  0.  Since  (see  [42]) 

(7.5)  vec-'[(5©5)vecA^]  =  5iV5^^0 
and 

(7.6)  (5©5)*  =  5*©5*, 
it  follows  that 

vec“‘  vec  A^j  =  2  (A:!)-'5W^^  0. 


fc-O 


(7.7) 

Furthermore, 

(7.8) .  vec”‘  vec  AT]  =  vec“‘  [(e'^©e^)  vec  A^]  =  e^Ne^^^O. 

Applying  (7.7)  and  (7.8)  alternately  with  (7.4)  and  using  induction  on  k,  it  follows  that 
the  integrand  of  (7.3)  is  nonnegative  definite.  To  prove  the  converse,  note  that  it  follows 
from  (MLE4)  that  Q  satisfies 

(7.9)  (2  =  vec“‘ [5'^'vec(2]+ f  vec"' vec  F]  rfr,  re[0,co). 

Jo 

Since  the  integral  term  on  the  right-hand  side  of  (7.9)  is  nonnegative  definite,  is  bounded 
from  above  by  Q,  and  Fe  is  arbitrary,  it  follows  that  sJ  is  asymptotically  stable.  □ 
We  now  show  that  if  jj/  is  asymptotically  stable  then  actually  Aa  (and  thus  .4)  is 
asymptotically  stable.  This  shows  that  the  assumption  that  s/  is  asymptotically  stable  is 
consistent  with  the  original  hypothesis  that  A  is  asymptotically  stable. 

Proposition  7.2.  Assume  sJ  is  asymptotically  stable,  let  a',  6  [0,  a,],  /  =  1,  •  •  ■  , 
p,  and  define 


sJ'^AaQA^+  2  ^^j/l,©A-. 


Then  sJ'  is  also  asymptotically  stable.  In  particular,  Aa  and  A  are  asymptotically  stable. 

Proof.  Let  Fe  be  arbitrary  and  let  Q  be  the  unique,  nonnegative-definite  solution 
of(MLE4).  Equivalently,  2 satisfies 


where 


0  =  AaQ  +  QAl+  2  \^^yiQAT+  V\ 


V'^  2  a-'(,a}-a'i^')AiQAT+  V. 

i>  I 


'  The  exponential  product  Tormula  is  essential  to  the  proof  here  since  {l)A,QA,  cannot  be  e.xpresscd  as 
a  Kronecker  product  SOS,  and  l2)AaOA.  and  2f. ,  ytA,  ©  Ai  do  not  generally  commute. 
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Since  V  e  N",  the  stability  of  now  follows  as  in  the  proof  of  the  converse  of  Proposition 
7.1.  Finally,  if  Fis  chosen  to  be  positive  definite  then  2/- 1  ! a)AiQAj  +  V  is  also 

positive  definite  and  it  follows  from  Lemma  12.2  of  [39]  that^ia,  and  hence  is  asymp¬ 
totically  stable.  □ 

Hence  it  follows  from  Proposition  7.2  that  a  necessary  condition  for  to  be  asymp¬ 
totically  stable  is  that 

(7.10)  a!<2  max  ReX,(v4). 

/-i. 

We  now  have  the  following  monotonicity  result. 

Proposition  7.3.  Let  c  ^2,  where  ‘^2  is  defined  as  in  (5.7)  with  a,-  replaced 
by  a'i  €  (0,  ai\,  i  =  1,  •  •• ,  p.  Furthermore,  let  V e  P",  assume  sd  is  asymptotically 
stable,  and  let  e  P"  satisfy  (MLE4).  Then  there  exists  Q'  e  P"  satisfying 

(7.11)  0=AaQ'+Q'A^+  i 


and,  furthermore, 

(7.12)  Q'^Q- 
Consequently, 

(7.13)  XtQ'R^XtQR, 

(7.14)  ^max  ^max 

Proof.  Subtracting  (7.1 1 )  from  (MLE4)  yields 

0=AAQ-Q')  +  {Q-Q’)AI+  2  {—]Ai{Q-Q')AT+V’, 

where  V  is  defined  in  the  proof  of  Proposition  7.2.  Since,  by  the  converse  portion  of 
Proposition  7.1,  sd’  is  asymptotically  stable,  Q-  Q''^0,  which  yields  (7.12)  and  thus 
(7.13)  and  (7.14).  □ 

Returning  now  to  the  existence  question.  Proposition  7. 1  shows  that  a  solution  to 
(MLE4)  exists  so  long  as  ai ,  •  •  * ,  are  sufficiently  small  such  that  sd  remains  asymp¬ 

totically  stable  for  some  a  >  0.  To  this  end  we  can  treat  this  as  a  stability  perturbation 
problem  and  apply  results  from  [3].  Within  our  modified  Lyapunov  equation  approach 
we  have  the  following  related  result.  For  this  and  the  following  result  let  ||  •  ||  denote  an 
arbitrary  vector  norm  on  R"*  and  the  corresponding  induced  matrix  norm. 
Proposition  7.4.  If 


(7.15) 


{A<£)A)~'\  al„7+a 


-1 


2  afAi®Aij 


<1. 


then  for  all  Fe  W"  there  exists  QeM”  satisfying  ( MLE4)  and  hence  sJ  is  asymptotically 
stable. 

Proof.  Define  {Qk}k-o  where  (2o satisfies  (3.14)  and  Qk+\  satisfies 
0=AQk*i  +  Qk*xA^+^AQk)+V- 
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Note  that  0*  ^  0,  fc  =  1,  2,  •  •  •  .  Hence  it  follows  that 

vec(2*+i-vece*  =  -(/(©^)“‘[vecfl7«2A:)-vec  ^AQk-\)] 

and  thus 

i|vecQfc+i-vec(2fcll^  U©^)"'|a/„j+a"*  2  a}A,®A,^  llvecCfc-vecefc-iil. 

Using  (7.15)  it  follows  that  Q  ^  linift^a,  Qk  exists.  Thus  Q^O  and  satisfies  (MLE4). 
Finally,  by  the  converse  of  Proposition  7.1, .«/  is  asymptotically  stable.  □ 

Since  (MLE5)  is  nonlinear,  a  slightly  difierent  approach  is  required  for  existence. 
For  the  following  result  let  x,  /3  >  0  satisfy 

(7.16)  \\e^'\\^Ke-^‘,  t^O, 

where  ||  ■  ||  denotes  an  arbitraiy  submultiplicative  matrix  norm  that  is  monotonic  on  W", 
and  define  p  A  2/3/x^ 

Proposition  7.5.  Suppose  Fe  1^"  and 

(7.17)  4a\\NUa-'M+V\\<p\ 

Then  there  exists  satisfying  (MLE5). 

Proof.  Consider  the  sequence  {Qk}k~o  where  Qo  satisfies  (3.14)  and  Qk+\  is 
given  by 

0-AQk+  \  Qk+  lA^  +  aQkNQk+ a~^  M  +  V. 

Clearly,  (2*  ^  0,  =  0,  1,  •  •  • .  Next  we  have 

(7.18)  (2*+i=  r e^'{aQkNQk+ CL-' M-^V]e^^‘ dt, 

Jo 

which  yields 

(7.19)  ||(2*+ill^ap-'l|A'llllQxlP  +  p-'ll«-'M+f'll. 

Similarly,  from  (3.14)  we  obtain 

llCoNp“'l|I^ll^p-'lk-'A/+Kl|. 


Now  suppose  that 


\\Qk\\^2p-'\\a-'M+V\\. 


Then  (7.17)  and  (7.19)  imply 

||Qfc^,Map-'liN||(2p-'|k-'M+ Fl|]2+p-'l|a-'M+ F|| 
<2p-'||a-'M+Fl|. 

Thus  WQkW  ^2p-'\\a-' M  +  V\\,k  =  (J,  1,  •••.  Next, (7.18) yields 

Qk^^-Qk  =  ci  r e^'[QkNQk-Qk- ^NQk-^\e^^'  dt 

Jo 


=  a  f “ e^'lQkm Qk-Qk-O+iQk-Qk-nh'Vk-tJe^^’  dt 
Jo 
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and  thus 

ll<2fc+ 1  -  <2J1  ^  ap-'ll  m  ( llQjtll  +  \\Qk-i\\)\\Qk-Qjc-i  II 
^4ap-^  ;V|1  l|a-‘M+  K|1  WQ^-Qk- ,  II 
^e|l<2/l:“<2*+lll> 

wheree^4ap"^||/^|||a“‘A/+  Kjl.  Since  by  (7.17)  c<  l,lim*..eo  Qt  exists,  is  nonnegative 
definite,  and  satisfies  ( MLE5 ) .  □ 

8.  Additional  upper  bounds  via  recursive  substitution.  In  this  section  we  obtain 
additional  upper  bounds  for  Js(^)  and  by  utilizing  a  recursive  substitution  tech¬ 
nique.  The  main  idea  involves  rewriting  (2.7)  as 

(8.1)  (3^A  =  -''ec~‘  {(A®A)~'(AA®AA)vecQ^}  +  Qo 

and  substituting  this  expression  into  the  terms  AAQ^a  +  appearing  in  (2.7). 

This  technique  yields  an  equation  that  is,  as  expected,  equivalent  to  ( 2.7 )  but  that  permits 
the  development  of  additional  bounds.  As  will  be  seen,  the  ability  to  develop  new  bounds 
exploits  the  fact  that  the  substitution  technique  leads  to  terms  that  are  quadratic  in  AA. 
We  be^n  the  development  with  the  following  technical  result  that  does  not  require  that 
A  be  asymptotically  stable. 

Proposition  8.1.  Suppose  A  Q  A  is  invertible  and  let  A/4  e  IfQi^A  satisfies 
(2.7),  then  Q^a  olso  satisfies 

0=^<2A/j  +  Qa/<^^-vec"'  [(A/l©A^)(^©.4)"'(A,4©Ai4)  vecG*^ 

+  (Ai4© Ay4)(/i©.(4)"'  vec  V]+  V. 

Conversely,  if  satisfies  (Z.2)  and  {A  -  AA)@  (A  -  AA)  is  invertible,  then  Q:,a  olso 

satisfies  (2.1). 

Proof.  To  obtain  (8.2)  substitute  (8.1 )  into  (2.7)  as  noted  above.  Conversely,  adding 
the  zero  term  {AA  ©  AA){A  ©  A)~*{A  QA)  vec  Q^a  -  (AAQ  AA)  vec  to  (8.2), 
it  follows  that  (8.2-)  can  be  written  as 

0  =  [(.4  -  A^ )© (^  -  A^ )](^©^)-‘  [(^  +  A^ )© (^  -b  A/4 )  vec  +  vec  V] , 

which,  under  the  invertibility  assumption,  implies  that  satisfies  (2.7).  □ 

The  following  result  is  analogous  to  Theorem  3. 1 .  We  shall  say  that  is  symmetric 
if  A,4  €  <21  implies  —AA  e 

Theorem  8. 1 .  Suppose  'dl  is  symmetric,  let  Ro  e  RJ"  satisfy 

(8.3)  A/lQo+eoA/4’"^fio,  AAe‘'ll, 


where  <2o  satisfies  (3.14),  let  S : 

(8.4) 


{yn  (yn  satisfy 


-vec"'  [(A/4©A/4)(^©/4)"'(A^©A/I)vec(2]^n(f2), 
and  suppose  there  exists  Qel^”  satisfying 

(8.5)  0=AQ+QA^+9.{Q)  +  %+V. 
Then 

(8.6)  {,A  +  AA,D)  isstabilizable,  AAe-'U, 


AAevlt,  Qef^", 
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if  and  only  if 

(8.7)  A  +  is  asymptotically  stable,  AAe‘2t. 

In  this  case, 

(8.8) 

where  Qca  satisfies  (2.7),  and 
■  (8.9)  Js{^)^trQR, 

(8.10)  Jom  —  ^BUX  (QR). 

Proof.  The  equivalence  of  (8.6)  and  (8.7)  follows  from  (8.5)  as  in  the  proof  of 
Theorem  3.1.  Next  (8.8)  follows  by  comparing  (8.5)  and  (8.2)  while  using  (8.3)  and 
(8.4).  Since  *2^  is  assumed  to  be  symmetric,  it  follows  from  (8.7)  that  .<4  -  AA  is  asymp¬ 
totically  stable,  A  A  €  Hi,  and  hence  t^A-  AA)®iA-  AAYts  invertible,  A  A  6  Hi.  Thus, 
the  converse  portion  of  Proposition  8.1  implies  that  Q^a  satisfying  (8.2)  also  satisfies 
(2.7).  Thus,  the  bound  (8.8)  can  be  used  to  obtain  (8.9)  and  (8.10).  □ 

The  principal  difference  between  (8.4)  and  (3.1)  is  that  AA  appears  linearly  in 
(3.1),  whereas  it  appears  quadraUcally  in  (8.4).  By  exploiting  this  structure  we  can 
obtain  new  bounds  for  Q^a-  To  simplify  matters,  we  now  consider  the  bound  in  (8.4) 
in  two  special  cases.  In  the  first  case  we  set  *2^  =  Hl^  and  ;?  =  1  so  that  AA  =  oiAi, 
I  ffi  I  ^  5| .  In  this  case  (8.4)  becomes 

(8.11) 

-cr?vec-'((/l,©^,)(^0^)-'(^,©^,)vec<2J^n{0,  QeM”. 

One  choice  of  n(  • )  that  immediately  suggests  itself  can  be  obtained  by  defining  the  matrix 
function  |  •  |  +  on  the  set  of  symmetric  matrices  by 

(8.12)  .  |5U^  1(5+151), 

which  effectively  replaces  the  negative  eigenvalues  of  5  by  zeros.  We  shall  thus  utilize 
the  fact  that 

(8.13)  aT5^of|5U,  k,|^5„ 
for  all  symmetric  5. 

Corollary  8.1.  LetVGP",Hl  =Hli,p=  l,  let  Go^^''5atisfy{S.3),  and  suppose 
there  e.xists  QeM"  satisfying 

(8.14)  O=yl<2+0>4^+5?I-vec-‘[(/l,©^,)(>4©/I)-'(/l,©^i)vccei|^.  +  fio+F. 

Then  (8.7)-(8.l0)  are  satisfied. 

For  the  next  specialization  we  shall  assume  that 

(8.15)  [AA)A=A{AA),  AA€^ll, 

which  holds,  for  example,  for  modal  systems  with  frequency  uncertainty  (see  §  10).  It 
thus  follows  that  (A  ©  /1)"‘(A/1  ©  AA)  =  (il,l  ©  A^)(>4  ©  yl)-*  and  thus  (8.4)  can 
be  rewritten  as 

(8.16)  AA-Q-r2AAQA.4^+QAA'^^R(Q),  AAg-21,  Qe^", 
where  Q  e  RJ"  satisfies 

(8.17) 


o=aq+qa~^q. 
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Assuming  in  addition  to  (8.15)  that  =  <7iAi,  |<ri|  ^  6i,  (8.14)  becomes 
(8.18)  0=AQ+QA^+dUA^Q+2AiQAT+QAV\  +  +  no+y- 

Remark  8.1.  It  is  interesting  to  note  tliat  the  left-hand  side  of  ( 8. 1 6 )  is  of  the  same 
form  as  %>{').  Specifically,  the  term  AA^Q  +  QAA^^  is  analogous  to  AjQ  +  QAV 
whereas  lAAQAA^is  similar  to  AiQAj. 

9.  An  alternative  approach  yielding  upper  and  lower  bounds.  In  this  section  we 
.'pvelop  a  variation  on  the  results  of  §  3  that  has  the  additional  benefit  of  yielding  both 
ipper  and  lower  performance  bounds.  The  basic  approach  was  suggested  by  results  ob¬ 
tained  in  [44].  To  simplify  the  presentation  we  assume  as  in  the  preceding  section  that 
^11  is  symmetric.  This  symmetry  assumption  of  course  holds  for  all  of  the  uncertainty 
sets  considered  in  previous  sections.  The  underlying  idea  involves  bounding  the  deviation 
of  from  Qa  rather  than  bounding  directly. 

Theorem  9.1.  Let  fio  e  H"' satisfy 

(9.1)  AAQo  +  QoAA'^^%,  A/4e^, 

to  fl :  W"  -►  1^"  ie  such  that  (2.1)  is  satisfied,  and  suppose  th  "'re  exists  AS-gM"  satisfying 

(9.2)  0  =  AA£l  +  A2A'^+il{A^)  +  Qo- 
Then 

(9.3)  {A  + AA,Q.y‘^)isstabilizable,  AAe^, 
if  and  only  if 

( 9.4 )  A  +  AAis  asymptotically  stable,  AAs‘^. 

In  this  case, 

(9.5)  Qo-A&£Q^A^Qo+A2i,  AAs^, 
where  is  given  by  (2.7),  and 

(9.6)  tr((2o  +  A^)i?^/5(‘'^)^tr(Qo  +  A5);?, 

(9.7)  Xm«[(eo-A5)i?]^7:)(<^^)^X„„[(Qo  +  A^)i?]. 

Proof.  Define 

(9.8)  AQAQ^,^-Qo 
and  subtract  (3.14)  from  (2.7)  to  obtain 

(9.9)  0  =  (^  +  AA)AQ  +  AQ{A  +  A/4)’"+  AAQo  +  QqAA'^. 

Nov  rewrite  (9.2)  as 

(MO)  0  =  (.4  +  A^)A^  +  A.2(.4  +  A>4)^+fi(A^)-(A^A^  +  A.2A.4^)  +  ftp. 

Using  (9. 10),  the  equivalence  oft,  9. 3)  and  (9.4)  is  immediate  as  in  the  proof  of  Theorem 
3.1.  Next,  subtracting  (9.9)  from  (9.10)  yields 

0  =  (/I  +  A/1 )( A5  --  AQ)  +  ( A^  -  A(2)(/4  +  A.4 )  fi(  A5) 

^  ^  ^  -{AAASl-y  ASIAA  ^)  +  fio  -  ( A/4(2o  +  QqAA  ^). 

Using  (3.1)  and  ( 9. 1 )  it  follows  from  (9.11)  that 

AS-AQ^O, 


r#-^* 
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or,  equivalently, 

(9.12)  Qa^^Go  +  A^. 

To  obtain  the  lower  bound  rewrite  (9.9)  as 

(9.13)  0  =  (^  +  A^)(-A<2)  +  (-  AG)(^  +  A/1)^-(A^Go  +  QoA^^). 

Also,  note  that  because  of  the  assumed  symmetry  of^Z^,  (9.1 )  holds  with  LA  appearing 
in  the  inequality  replaced  by  -  A^.  Hence  it  can  be  shown  similarly  that 

A^  +  AQ^O, 


or,  equivalently, 

(9.14)  Go-A^^Ga.!. 

Finally,  (9.6)  and  (9.7)  follow  from  (9.5).  □ 

Remark  9.1.  To  compare  the  upper  bound  in  (9.5)  with  (3.5),  rewrite  (9.2)  as 

(9.15)  Q  =  A{Qq  +  La.)  +  {Qo-¥  La.)A'^+Q{LSl)  +  %->rV. 

If  P(  A5)  +  fto  =  n(Go  +  A.2)  then  (9.15)  has  the  same  form  as  (3.2)  and  thus  the  two 
upper  bounds  are  identical.  This  will  be  the  case,  for  example,  if  n(-)  =  fi7(‘)  and  fio  is 
chosen  to  be  fi7(Go)  since  fi7(-)  is  linear.  If,  however,  fi(A^)  +  Qq  <  ^^(Go  +  LSI)  then 
the  upper  bound  in  (9.5)  will  be  sharper.  In  any  case  it  is  clear  that  the  individual 
treatment  of  L3,  and  Go  yields  potentially  new  upper  bounds. 

Remark  9.2.  Theorem  9.1  does  not  guarantee  that  the  lower  bound  Qo  -  LSI  for 
is  nonnegative  definite.  However,  Ga.4  is  always  nonnegative  definite  and  thus  the 
lower  bound  in  ( 9.5 )  may  be  of  limited  usefulness.  Nevertheless,  if  Go  “  A.2  is  indefinite 
then,  depending  on  i?,  the  lower  bounds  in  (9.6)  and  (9.7)  may  still  be  positive  and  thus 
be  meaningful  lower  bounds. 

10.  Analytical  examples.  In  this  section  we  consider  simple  analytical  examples 
that  illustrate  the  principal  results  of  the  paper.  These  examples  also  provide  insight  into 
the  individual  characteristics  of  different  bounds  as  a  prelude  to  numerical  examples 
considered  in  the  following  section. 

To  begin  we  consider  the  simplest  possible  example.  Set  «  =  1,  ^  <  0,  i?  >  0, 
V>  0,At  =  1,  and<=i^  =  {A^  :  \LA\  ^  5i}.  For  5i  <  -A,  Qi,a  =  Vjl{\A\  -  LA) 
a:.d  Js^^H)  =  =  RVI2{\A  \  -80,  where  this  worst-case  performance  is  achieved 

for  LA  =  5i.  Solving  (MLEl)  yields  Q  =  K/2(M|  -  5,),  which  is  a  nonconservative 
result  for  both  robust  stability  and  performance.  The  same  result  is  obtained  from 
(MLE4)  by  setting  a  =  a,  =  5,.  To  apply  (MLE5),  set  5,  =  Choosing  a  = 

25,  ( M I  -  5i ) A^Fagain  yields  the  nonconservative  result.  Finally,  the  same  result  follows 
from  Theorem  8.1. 

For  the  second  example  we  consider  nondestabilizing  uncertainty  in  the  imaginary 
component  of  an  uncertain  eigenvalue,  i.e.,  frequency  uncertainty,  in  contrast  to  uncer¬ 
tainty  in  the  real  part  considered  in  the  previous  example.  Let  n  =  2, 


A  = 


—  V 


— <j 


-V 


v>0,  wSO, 


K=/?  =  72,and‘Z'  ={LA:LA  =  a\Ai,  kil  ^5,},  where 
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Obviously,  A  +  AA  remains  asymptotically  stable  for  all  values  of  ai  since  AA  affects 
only  the  imaginary  part  of  the  poles  of  A^.  The  question  then  is  whether  the  robustness 
tests  are  able  to  guarantee  this  robustness.  Note  also  that  because  of  the  choice  of  V, 
Qt>.A  “  Go  =  (2i')"‘/2  for  all  AA  e  For  this  example  we  note  that  (MLEl )  is  satisfied 
by  G  =  (2j/)"'/2,  which  is  independent  of  5i,  Thus  (MLEl)  possesses  a  nonnegative- 
definite  solution  for  all  5i  >  0,  which  shows  that  (MLEl )  is  nonconservative  with  respect 
to  robust  stability  and  performance.  Since y4(A,4)  =  iAA)A,it  can  also  be  seen  that  the 
same  result  holds  for  (8.18).  The  situation  is  considerably  different  for  (MLE4)  and 
(MLE5).  To  analyze  (MLE4)  note  that  .s/  has  an  eigenvalue  —2p  +  a  +  5i.  (This  can 
be  shown  by  diagonalizing  ^4  and /4i  and  thus  s/.)  Since,  by  Proposition  7.1,  must  be 
asymptotically  stable,  we  require  6i  <  2v.  This  is,  of  course,  an  extremely  conservative 
result,  especially  when  the  damping  v  is  small.  For  (MLE5)  we  can  factor  Ai  =  D\E\. 
Thus,  let  D{  =  I2  and  E\  =  A\  and  define  M  =  61/2  and  N  =  h.  Assuming  that  Q  is  a 
multiple  of  h,  it  follows  that  Q  is  nonnegative  definite  only  if  5i  ^  i',  which  is  again  an 
extremely  conservative  result.  The  reason  for  this  conservatism  becomes  clear  by  noting 
that  M  and  iV  as  given  above  will  also  serve  as  bounds  for  perturbations  of  the  form  ai  I2 
for  which  the  range  of  nondestabilizing  (Ti  is  |  <ri  |  <  61 .  This  will  also  be  the  case  for  all 
factorizations  D^Ei  of  Ax  since  DiDl  and  El  Ex  must  be  positive  definite  and  thus  will 
also  serve  as  bounds  for  destabilizing  perturbations  such  as  ffxh- 

Finally,  we  consider  a  nondestabilizing  uncertainty  affecting  the  interaction  of  a  pair 
of  real  poles.  Lttn  =  2,A  =  -I2,  V  =  R  =  I2,  and^  =  [AA:  AA  =  axAx,  \cx  \  ^  5i}, 
where 


Ax  = 


0  1 
0  0 


Obviously,  A  +  AA  remains  asymptotically  stable  for  all  values  of  ffx  since  AA  does  not 
affect  the  nominal  poles.  Note  that 


Q^a  ~ 


a?/4+i 

(7,/4 


axK 

i  . 


and  =  is?  +  1,  where  this  worst-case  performance  is  achieved  for  <ri  =  5i .  In  this 
case  (MLEl)  has  the  solution  Q  =  {2  -  5x)~'h,  which  is  valid  only  for  S|  <  2,  an 
extremely  conservative  robust  stability  result.  Furthermore,  the  corresponding  perfor¬ 
mance  bound  tr  QR  =  2(2  -  Si)"'  is  conservative  with  respect  to  the  actual  worst-case 
performance  iS?  +  1.  In  contrast,  (MLE4)  has  the  solution 

(2-a5,)-'  +  a-'S,(2-aS,)-2  0 

0  (2-aS,)-'j’ 


which  is  nonnegative  definite  for  all  S|  so  long  as  a  <  2/5i .  Hence  (MLE4)  is  noncon¬ 
servative  with  respect  to  robust  stability.  For  robust  performance, 

tr^27^  =  2(2-aS,)-'  +  a-'S,(2-aS,)-^ 

which  can  be  shown  to  be  an  upper  bound  for  iS?  +  1.  Choosing,  for  example,  a  = 
S7'  yields  tr  QR  =  8]  +  2.  The  parameter  a  can  also  be  chosen  to  minimize  tr  QR, 
although  this  is  somewhat  tedious  to  carry  out  analytically.  Finally,  (MLE5)  has 
the  solution 


'kil+a-'5x) 

0 


0 

[l-(l-a5,)'/2]/a5, 
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which  exists  so  ’ong  as  a  ^  l/5i.  Hence  (MLE5)  is  also  nonconservative  with  respect 
to  robust  stabiiu'y.  Choosing  a  =  l/5i  yields  XxQR  =  {b\  +  |,  which  lies  above  the 
nonconservative  bound  iS?  +  1.  Again,  a  can  be  chosen  to  minimize  tr  QR. 


11.  Numerica!  examples.  In  this  section  wc  consider  additional  examples  illustrating 
the  results  developed  in  earlier  sections.  In  contrast  to  the  analytical  examples  considered 
in  §  10,  however,  we  consider  more  complex  examples  by  numerically  solving  the  modified 
Lyapunov  equations.  Here  we  focus  on  (MLE4)  and  (MLE5),  which  arc  the  easiest  to 
solve  numerically.  Specifically,  we  solved  (MLE4)  by  using  the  representation  (7.2) 
(although  this  may  not  be  practical  when  n  is  large),  and  we  solved  (MLE5)  by  means 
of  a  standard  Riccati  package.  To  simplify  matters  we  consider  only  uncertainties  AA  of 
the  form  criAi.  Evaluation  and  presentation  of  robust  stability  and  performance  results 
for  multiparameter  uncertainty  can  be  fairly  complex  and  thus  arc  deferred  to  a  future 
numerical  study. 

Since  both  robustness  tests  (MLE4)  and  (MLE5)  depend  on  an  arbitrary  positive 
constant  a,  it  is  desirable  to  determine  the  value  of  a  that  yields  the  tightest  (i.e.,  lowest) 
performance  bound  for  each  robust  stability  range.  To  this  end  we  performed  a  simple 
one-dimensional  search  to  determine  the  best  such  a.  Although  analytical  techniques 
may  assist  in  determining  optimal  values  of  a  more  efficiently,  the  search  technique 
proved  to  be  adequate  for  the  examples  considered  here. 

As  a  first  example  we  consider  the  control  system  given  in  [1]  to  demonstrate  the 
lack  of  a  guaranteed  gain  margin  for  LQG  controllers.  Hence  consider 


(11.1) 

(11.2) 

with  controller 

(11.3) 

(11.4) 

and  performance 

(11.5) 

The  data  are 


;cb(/)  =  ^oXo(0  +  .5o«(0  +  »’i(0> 
y(0  =  CoX'o(0  +  w'2(0, 

Xe(t)=AcXc(0  +  Rey(0, 

U(t)  =  CeXc(0, 


J=  lim  + 

/-•  00 


1  1 
0  1 


Aq- 

y,=Ri=p 


,  Bo  — 


1  1 
1  1 


,  -Co^Il  0], 

y2=R2=i, 


where  V,  and  V:  are  the  intensities  of  ^1(0  and  y>'2(0,  respectively.  Uncertainty  ABo 
in  Bo  is  thus  represented  by  ffiBi ,  where  5i  =  [0  l)’^.  Thus  the  closed-loop  system  corre¬ 
sponds  to 


A  = 


R  = 


■  Ao 

A.  = 

0  5,Cc‘ 

BcCo 

.0  0 

R,  0 
0  0 


K,  0 

LO  BcViRf. 
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where  the  zero  in  the  (2, 2)  block  of  R  denotes  the  fact  that  we  are  considering  the  robust 
performance  bound  for  the  state  regulation  cost  only.  Choosing  p  =  60,  it  follows  that 
the  LQG  gains  are  given  by 


Ac= 


■lO" 

.10. 


Cc  =  [-10  -10]. 


For  this  controller  the  actual  stability  region  corresponds  to  ai.e  (-.07,  .01 )  so  that  the 
largest  symmetric  re^on  about  =  0  is  Itfil  <  .01.  The  worst-case  performance  over 
each  stability  re^on  1  ci  1  <  5i  is  denoted  by  the  solid  line  in  Fig.  1,  whereas  the  perfor¬ 
mance  bounds  obtained  from  (MLE4)  and  (MLE5)  are  shown  for  several  values  of  5|. 
For  (MLE5)  we  set  =  [0  1  0  0]^  and  £i  =  [0  0  Ce).  Note  that  (MLE5)  yields 
considerably  tighter  estimates  of  worst-case  performance,  particularly  as  5i  approaches 
.01.  For  (MLE4)  optimal  values  of  a  were  in  the  range  .(X)12  to  .0058,  whereas  for 
(MLE5)  (with  (2io'(*).  see  (5.26))  a  was  in  the  range  .01 43' to  .0020. 

As  a  second  example  we  consider  a  pair  of  nominally  uncoupled  oscillators  with 
uncertain  coupling.  This  example  was  considered  in  [45]  using  the  majorant  Lyapunov 
technique.  Let 


■  —V 

Wi 

0 

0  ■ 

’0 

0 

1 

o' 

A  = 

-Wi 

0 

—  V 

0 

0 

—I' 

0 

ti)2 

.  ^1  = 

0 

1 

0 

0 

0 

0 

1 

0  ' 

0 

0 

—  6)2 

—  V 

0 

1 

0 

0. 

V  —  .2,  <t)i  — .2,  <iJ2®L8,  R—V—I^, 


and,  for  (MLE5),  define  D\  =  A\  and  £i  =  h.  We  consider  bounds  on  only. 


|Tnrrp » ii|ri  ii|HTr(Ti  npTriii  M171 1  riii  i  m/i  ytun  i  m  1 1  nnrui  iiT|  j  jvr|i  1  n^Ti  1  n 

0.0  1.0  2.0  3.0  4.0  5.0  6.0  7.0  8.0  9.0  10.0 

STABILITY  REGION  5,  (x10-») 


Fig.  1 


ROBUST  STABILITY  AND  PERFORMANCE  269 


FIG.  2 


Figure  2  illustrates  the  exact  worst-case  performance  along  with  performance  bounjJs 
obtained  from  (MLE4)  and  (MLE5).  For  (.MLE4)  optimal  values  of  a  ranged  from  .036 
to  .141,  whereas  for  (MLE5)  optimal  a  was  between  .361  and  .096.  Although  (MLE4) 
was  slightly  less  conservative  than  (MLE5),  both  bounds  were  able  to  guarantee  robust 
stability  only  for  5i  =  .15,  whereas  the  largest  stability  region  is  actually  5]  =  .54.  It  is 
interesting  to  contrast  this  result  with  [45]  where  the  majorant  Lyapunov  technique 
yielded  a  robust  stability  range  of  6i  =  A  for  a  richer  class  of  off-diagonal  blocks  having 
maximum  singular  value  less  than  5] . 

12.  Concluslcn.  A  variety  of  quadratic  Lyapunov  bounds  have  been  developed  for 
both  robust  stability  and  performance.  It  seems  clear,  however,  that  no  single  quadratic 
Lyapunov  bound  is  superior  to  the  others.  Although  the  conservatism  of  each  bound  is 
problem  dependent,  it  is  desirable  to  better  understand  the  nature  of  the  conservatism 
in  order  to  utilize  the  bounds  in  an  effective  manner.  In  addition,  the  issue  of  necessity 
remains  to  be  addressed.  That  is,  if  a  system  is  robustly  quadratically  stable  (i.e.,  robustly 
stable  with  a  corresponding  Lyapunov  function),  then  is  such  a  Lyapunov  function 
necessarily  given  by  one  of  the  modified  Lyapunov  equations  given  in  this  paper?  Fur¬ 
thermore,  a  belter  understanding  is  needed  of  the  gap  between  robuat  stability  and  robust 
quadratic  stability. 

Acknowledgment.  We  thank  A.  W.  Daubendiek  for  producing  the  numerical  results 
in§  11. 

Note  added  in  proof.  ( 2 )  The  assumption  j:(0)  =  0  in  ( 2.2)  is  stronger  than  necessary 
for  the  treatment  of  (2.4).  If  x(0)  #  0,  then  Lemma  2.1  remains  unchanged  since  the 
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effect  of  x(0)  vanishes  as  t  oo.  If,  however,  x(0)  =  0,  then  Q^aU)  is  increasing  on 
[0,  CO )  and  (2.4)  is  equivalent  to 

^s(^)=  sup  sup  E{  !!>'(/) II 

iUe-H  l£[0,cs) 

For  7£,(^),  a:(0)  =  0  is  essential  since  ||>!(*)llco.2  involves  the  supremum  over  [0,  oo). 
If  ;c(0)  0,  then  the  analysis  can  possibly  be  redone  by  considering  the  supremum  over 

[/,  00 )  and  letting  t  -►  oo  to  eliminate  the  effect  of  the  initial  condition. 

(2)  A  relationship  between  the  linear  bound  • )  and  the  quadratic  bound  fiio(  * ) 
can  be  seen  as  follows.  If  AA  =  aiAi ,  |  <ri  |  ^  Sj ,  then  factor  AA  =  A^Ar  as  in  according 
toAL  =  ffiAiQ'^^andAR  =  with  bounds  A/ =  5?i4iQ/4i'and 7V=C~'.  The  unusual 

feature  here  is  that  the  “splitting”  of  AA  is  (2*dependent.  Then,  by  (5.22), 

ilto(Q)  =  a-^SUiQAT+aQ, 

which  has  the  form  of  Sls(Q). 
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Abstract 

Kharitonov’s  theorem  provides  a  necessary  and  sufficient  analysts  test  for  robust  stability  of 
polynomials  whose  coefficients  lie  within  a  hyperrectangle.  In  this  note  we  present  a  method  based 
upon  Kharitonov’s  theorem  for  synthesizing  robustly  stabilizing  feedback  controllers.  Our  approach 
is  based  upon  a  multiple  plant  model  formulation  with  a  quadratic  cost  functional.  Sufficient 
conditions  are  obtained  for  characterizing  robustly  stabilizing  static  output  feedback  (proportional) 
controllers  for  MIMO  plants  with  denominator  polynomial  uncertainty. 
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1.  Introduction 


Kharitonov’s  theorem  provides  a  necessary  and  sufficient  analysis  test  for  determining  the 
robust  stability  of  polynomials  with  perturbed  coefficients  [1].  Although  Kharitonov’s  original 
result  was  limited  to  uncertain  polynomials  having  independently  varying  coefficients,  considerable 
progress  has  been  achieved  in  generalizing  this  result  to  more  general  regions  [2-8].  Although 
these  results  are  useful  for  analyzing  the  stability  robustness  of  a  given  feedback  control  system, 
there  are  relatively  few  results  that  exploit  Kharitonov’s  theorem  for  synthesizing  robust  controllers. 
Notable  exceptions  are  [9-11]  which  give  necessary  and  sufficient  conditions  for  robust  stabilizahility 
of  uncertain  plcints. 

The  goal  of  the  present  paper  is  to  develop  sufficient  conditions  that  can  be  used  for  synthe¬ 
sizing  such  robustly  stabilizing  controllers.  Our  approach  considers  a  class  of  MIMO  systems  in 
companion  state  space  form  with  denominator  polynomial  uncertainty.  By  limiting  the  controller 
to  be  proportional,  i.e.,  static  output  feedback,  the  hyperrectangular  structure  of  the  parameter  un¬ 
certainty  is  preserved.  Hence  it  suffices  to  simultaneously  stabilize  the  four  “plants”  corresponding 
to  Kharitonov’s  theorem. 

Although  there  exists  extensive  literature  on  simultaneous  stabilization  (see  [11]  and  the  refer¬ 
ences  therein),  we  adopt  here  a  fixed-structure  approEu:h  involving  multiple  models  with  a  quadratic 
performance  functional  [12].  This  approach  allows  us  to  develop  reasonably  general  conditions  for 
robust  static  output  feedback  (proportional  control)  synthesis.  Although  extensions  to  dynamic 
compensation  are  significantly  more  complex,  we  also  show  how  SISO  systems  without  zeros  can 
be  treated  in  a  similar  fashion  by  means  of  integral  control. 

2.  Problem  Formulation 


We  begin  with  a  matrix  formulation  of  Kharitonov’s  theorem.  For  *  =  0, . . .  ,n  -  1,  let  and 
Pi  be  given  uncertainty  bounds  with  p.  <  Pi. 


Lemma  2.1.  Consider  the  set  of  matrices 
A 


1 


Then  every  matrix  in  is  stable  if  amd  only  if  the  four  matrices 

0(n-l)xl  In-l 

0(n-l)xl  In-1 

are  stable. 

Remark  2.1.  As  noted  in  [3],  simplification  is  possible  if  n  =  2,3,4.  If  n  =  2,  then  it  sufiices 

to  check  A3,  ff  n  =  3,  then  it  sufiices  to  check  A3  and  ^  >  0.  Hence,  for  n  =  3,  either  of  the  pairs 

(A3,Ai)  or  (A3,  A2)  suffices.  If  n  =  4,  then  it  suffices  to  check  A2,A3,  and  >  0.  Hence  either 

of  the  triples  (Ai,  A2,  A3)  or  (A2,  A3,  A^)  suffices.  Simplification  to  these  cases  of  the  results  given 

in  later  sections  is  obvious  and  thus  will  not  be  noted  explicitly. 

% 

For  the  statement  of  the  Robust  Controller  Synthesis  Problem,  let  A,  B,  C  denote  n  x  n,  n  x  m, 
and  £  X  n  matrices,  respectively,  and  let  x  =  r(t),  u  =  u{t),  and  y  =  y(t)  denote  n— ,  m— ,  and 
£-dimensional  vectors,  respectively. 

Robust  Controller  Synthesis  Problem.  Consider  the  dynamical  system 

i  =  Ar  +  Su,  x(0)  =  xo, 
y  =  Cx, 

where  A  6  A.  Then  determine  an  output  feedback  control  law  of  the  form 


11 

(2.3) 

such  that  the  closed-loop  system 

X  =  (A  -r  BKC)x 

(2.4) 

is  stable  for  all  A  €  A. 

The  key  step  in  exploiting  Lemma  2.1  is  to  assume  that  the  n  x  m  matrix  B  has  the  form 

®(n— l)xm 

B  = 

6 

where  6  has  dimensions  1  x  m.  No  assumptions  are  needed  concerning  the  structure  of  C.  Then 
we  have  the  following  corollary  of  Lemma  2.1. 


(2.1) 

(2.2) 


A3  = 


0(ti-l)Xl  In-l 


0(n-l)xl  In-1 

-h-2-pn-l\ 


A2  = 


2 


Corollary  2.1.  Let  K  he  &  given  mx  i  matrix  and  consider  the  set  of  matrices 


A  =  {A  +  BKC:  AeA}. 

Then  every  matrix  in  ^  is  stable  if  and  only  if  the  four  matrices  A  =  Ai  +  BKC,  t  =  1, . . .  ,4,  are 
stable. 


Proof.  Every  matrix  in  is  of  the  form 

0(n-x)xl  In-l 

,  -00  +  bKCi  +  bKCi  •  •  •  -  iSn-i  +  bKC„ 

where  Ci  is  the  tth  column  of  C.  Defining,  for  t  =  0, . . . ,  n  — '  1, 


Si^0i-bKCi^u  Si^§^.-bKCi^u  8i^Pi-bKCi^^, 


it  follows  that  A  can  be  written  as 


Now  note  that  the  closed-loop  matrices  in  A  have  the  same  structure  as  the  open-loop  matrices 
in  A.  Furthermore,  the  matrices  Ai , . . . ,  A*  now  play  the  same  role  as  Ai , . . . ,  A4  with  uncertain 
parameters  00, •  •  •  ,Pn-i,  lower  bounds  0^, . . .  and  upper  bounds  00,- ••  ,Pn-i  replaced  by 

5b> •  •  •  j bn-i,  lower  bounds  5o> •  •  •  “d  upper  bounds  So,..., Sn-i,  respectively.  □ 


Next,  as  in  (12],  we  consider  an  augmented  system  of  dimension  4n  that  simultaneously  includes 
the  dynamics  of  Ai, . . . ,  A*.  Specifically,  consider 


where 


Note  that 


where 


X 


Aai 


■21’ 

fAi 

0 

0 

0  ■ 

A 

X  = 

X2 

S3 

3  *^0  ”* 

0 

0 

A2 

0 

0 

Az 

0 

0 

.X4. 

.  0 

0 

0 

aJ 

4 


t=l 


0 

A2 

0 

0 


0 

0 

Az 

0 


0  - 
0 

0  ’ 
A^. 


(2.5) 


(2.6) 


3 


Cia  =  [C  0  0  0],  C2a  =  l0  C  0  0], 

C3a  =  [0  0  C  0],  C4a  =  [0  0  0  C]. 

(Note  our  notation  scheme:  (")  denotes  closed  loop,  (  )a  denotes  augmented  system.) 

We  now  turn  to  the  problem  of  explicitly  synthesizing  a  controller  that  stabilizes  (2.5)  and 
hence  the  original  system  (2.1),  (2.2)  for  all  A  €  >1. 

3.  Controller  Synthesis  via  Quadratically  Optimal  Control 

To  synthesize  a  controller  for  the  system  (2.5),  we  consider  a  quadratic  performance  functional 

of  tae  form  ^ 

J(K)  =  '^f  \xjRiXi  +  v,jR2Ui  dt,  (4.1) 

i^iJo  L 

where  Ri  and  R^  are  n  x  n  and  m  x  m  positive-definite  matrices,  and  u,-  is  defined  by 

Ui  =  KCxi. 

It  now  follows  that  J{K)  is  given  by 

J{K)=  f  x^Raxdt,  (4.2) 

Jo 

where 

Ri  +  {KC)’^R2KC  0  0  0 

0  Ri  +  {KC)'^R2KC  0  0 

0  0  Ri  +  {KC)’^R2KC  0 

0  0  0  Ri  +  {KCYR2KC 

Note  that  Ra  =  Ra  +  RzKCia,  where  Ra  is  defined  by 

-iZ  0  0  0- 

n  ^  0  iZ  0  0 

“  “  0  0  iZ  0  • 

.0  0  0  iZ. 

Writing 

rzo 

x(t)  =  xo  = 

XQ 
-Xo 


4 


leads  to 


J{K)  =  f  XQe^**Rae^‘^s:o  dt, 
Jo 


(4.4) 


where  we  are  now  assuming  that  K  is  such  that  Aa  is  stable.  Now,  as  is  common  practice  [13],  we 
eliminate  explicit  dependence  on  the  initial  condition  zo  by  assuming  xqXq  has  expected  value  J„ 
(n  X  n  identity).  Invoking  this  step  leads  to 


J(iir)  —  Ie|^  tr  J  dt 

=  tr  hr.  n  dt 

Jo 


=  tr  jP, 

where  P  is  the  4n  x  4n  positive-definite  solution  to 

0  =  AjP  +  PAa-i-Ra 

To  minimize  J{K)  we  form  the  Lagrangian 


(4.5) 


Z{K,P,Q)^  tr 


P  +  Q{AjP-i-PAa-hRa) 


where  Q  is  a  4n  x  4n  Lagrange  multiplier  matrix.  Note  that 


r  ■*  *  ' 

CiKrPrQ)  =  tr\p  +  2Ar,QP  +  2j2BiaKCiaqP  +  QR„  +  J2Q^TaK'^R2^<^i^ 

^  <=X  f=l 


Hence 


so  that  dZ/dK  =  0  yields 


dZ 

dK 


=  2J2  ]cioQPBia  +  Ci^QClK'^R^ 


\  *  1  f  <  1 

^  I E  BjMcl  E  ■ 

Li=l  U=1 


Similarly,  evaluating  dKJdP  =  0  yields 

0  =  AaQ  -b  +  hn- 

We  thus  have  the  following  result. 


(4.6) 


(4.7) 


Theorem  3.1.  Let  JiT  be  a  feedback  gain  that  stabilizes  (2.5)  and  minimizes  (4.1).  Then  K  is 
given  by 


K=-R^^ 


i=l 


J^BlPQCl  Y.^iaQC\ 
Li=l 


T-l 


(4.8) 
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where  Q  and  P  satisfy 


(4.9) 

(4.10) 


0  =  AaQ  +  QA^  +  lin, 

0  =  A^P  +  PAa  +  Ra- 


Note  that  the  matrices  A  and  Ra  depend  upon  K  so  that  (4.8)-(4.10)  must  be  solved  nu¬ 
merically  together.  The  expression  (4.8)  for  K  can  be  substituted  into  (4.9),  (4.10)  to  eliminate 
this  dependence.  This  optimal  static  output  feedback  solution  is  essentially  a  generalization  of  the 
stzindard  theory  [13]. 

4.  SufiBciency  Rc  jult  for  Robust  Stability 

Since  (4.9)  and  (4.10)  are  Lyapunov  equations,  they  guarcintee  the  stability  of  Aa  when  they 
have  solutions.  Since,  furthermore,  A  is  a  block-diagonal  matrix,  each  of  its  (four)  diagonal  blocks 
will  be  stable.  Finally,  by  Corollary  2.1,  the  stability  of  these  four  matrices  is  sufficient  to  guarantee 
the  stability  of  the  closed-loop  system  (2.4)  for  all  A  €  A,  i.e.,  for  all  variations  in  the  given 
uncertainty  set. 

Theorem  4.1.  Suppose  that  a  solution  to  (4.8)-(4.10)  can  be  computed  numerically.  Then 
the  resulting  gain  K  solves  the  Robust  Controller  Synthesis  Problem. 

Since  (4.8)-(4.10)  arise 'from  a  parametric  LQ  problem,  there  exist  a  variety  of  numerical 
methods  that  can  be  used  to  solve  them.  Here  we  note  the  extensive  survey  [14]  as  well  as  the 
homotopy-based  methods  used  in  [15,16]. 

5.  Integral  Control 

Static  output  feedback  was  considered  in  previous  sections  since  it  preserves  the  “Kharitonov” 
structure.  Dynamic  compensation  is,  of  course,  considerably  more  complex.  We  now  consider,  as 
in  [10],  the  possibility  of  utilizing  cin  integral  controller.  Our  results  are  more  restrictive  than  [10] 
with  regard  to  the  admissible  plants. 


Specifically,  we  consider  the  realization 

A  = 


0(n-l)xl 

B  = 

0(n-l)xl 

-^0 

_^1 - 

,  ID  — 

h 

,  C=  [1  0  •••  0] 


corresponding  to  a  SISO  plant  with  no  zeros.  Letting  the  control  u  be  given  by 


u  =  Kpy  +  Ki 


h 


6 


leads  to  closed-loop  dynamics  of  the  form 


X  =  Ax, 


where 


xj  =  integrator  state, 


and 


In 

—^0  -H  bKp  .  •  •  —  ^n-l  + 


Note  that  A  preserves  the  companion  structure  needed  to  apply  Lemma  2.1.  Optimization  can 
then  proceed  as  in  the  static  controller  case.  The  details  are  thus  omitted. 
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herein,  although  to  a  lesser  extent.  For  further  background  see  [29],  [30].  For  extensions 
to  nonstrictly  proper  controllers  see  [31],  and  for  extensions  to  control  see  [32]. 

To  explain  the  rationale  behind  the  development  we  briefly  describe  the  main 
elements  of  the  approach.  The  following  discussion  is  intended  to  be  descriptive; 
precise  conditions  appear  in  the  main  body  of  the  paper. 

1.1.  Robust  Stability  Problem.  For  a  nominal  linear  time-invariant  {A,  B,  C)  sys¬ 
tem  we  consider  deterministically  modeled  bounded  but  otherwise  unknown  Lebesgue 
measurable  time-varying  parameter  variations  of  the  form 

(1.1)  A+Y.^iU)Ai,  C+lCTi(r)C,. 

i»i  <-i  »»i 

The  nominal  matrices  A,  B,  C  and  the  perturbation  matrices  A,-,  B„  Q  denoting  the 
structure  of  the  parametric  uncertainty  are  assumed  known,  while  the  time-varying 
uncertain  parameters  <T,(r)  are  assumed  only  to  satisfy  the  bounds 

(1.2)  l<Ti(/)|g5,,  i  =  l,---,p,  /6[0,oo). 

The  form  of  (1.1)  permits  an  arbitrary  number  of  uncertain  parameters  with  arbitrary 
linear  structure.  Although  we  do  not  require  matching  conditions  as  in  [21],  the  linear 
structure  of  (1.1)  js  more  restrictive  than  the  functional  form  A(q(f))  used  in  [21].  It 
is  this  structure  that  we  exploit  to  obtain  sufficiency  conditions.  Note  also  that  the 
representation  (1.1)  is  independent  of  state  space  basis,  since  replacing  A  by  SAS"' 
corresponds  to  replacing  A,-  by  SA,S"'.  As  will  be  seen,  our  robustness  bounds  and 
optimality  conditions  are  also  basis  independent.  Also,  scaling  techniques  [6],  [7]  will 
not  play  a  role  here.  Finally,  we  note  that  because  of  the  time-varying  nature  of  the 
uncertain  perturbations  (1.1)  it  is  virtually  impossible  to  determine  the  actual  stability 
region  of  a  given  design  by  means  of  empirical  methods. 

1.2.  Quadratic  Lyapunov  function.  As  a  sufficient  condition  for  characterizing 
solutions  of  the  Robust  Stability  Problem  we  consider  a  closed-loop  quadratic 
Lyapunov  function  V{x)  =  x^§‘x,  where  the  matrix  &  satisfies 

(1.3)  0  =  A^5>  +  ^A-l-n(S»,B„Cc) 
and  the  function  Q  is  a  bound  satisfying 

(1.4)  i  <rXAj9-r9A,)<ni,9,  B„  CJ 
over  the  parameter  range 

(1.5)  NS5i,  i  =  l-,---,p. 

Note  that  the  constant  o-j  in  (1.4)  and_(1.5)  pjays  the  role  of  ct,(/),  i.e.,  i  is  “frozen" 
in  (1.4)  and  (1.5).  In  (1.3)  and  (1.4),  A  and  A,  denote  the  closed-loop  dynamics  and 
closed-loop  parameter-uncertainty  matrices  given  by 


Since  A,  is  independent  of  A„  fl  depends  only  on  B^  and  C,.  As  discussed  later  in 
this  section,  (1.4)  is  automatically  satisfied  by  construction  of  the  function  fl.  Further¬ 
more,  the  existence  of  a  solution  ^  to  (1.3)  need  not  be  verified  directly,  but  rather  is 
a  result  of  numerically  solving  the  optimality  conditions  discussed  below. 
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1.3.  Robust  Performance  Problem.  In  addition  to  the  deterministic  parameter 
uncertainty  model  (1.1),  (1.2),  the  Robust  Performance  Problem  includes  stochastic 
plant  disturbances  and  measurement  noise  with  performance  measured  by  means  of 
the  quadratic  functional 

(1.7)  j^t)  =  x^{t)R^x(^)+2x^(t)R,^uit)  +  u'^(t)RMt). 

To  obtain  a  steady-state  design  problem  we  (l);?.verage  J(t)  over  the  disturbance  and 
measurement  noise  statistics;  (2)  pass  to  the  steady-state  limit;  and  (3)  maximize  over 
the  class  of  parameter  uncertainties.  Hence  the  performance  of  a  given  controller 
(/!„  B„  Q)  is  given  by 

(1.8)  J(Ac,  Be,  Ce)  =  suplimsupE[J(f)]. 

ff(-)  i-tc 

The  use  of  “lim  sup”  is  a  technicality  that  accounts  for  cases  in  which  the  steady-state 
limit  may  not  exist.  Note  that  although  (1.8)  is  an  averaging  criterion  over  the 
disturbances  as  in  LQG  theory,  it  is  also  a  worst-case  measure  over  the  uncertain 
parameters.  Thus  (1.8)  js  a  hybrid  criterion  in  the  sense  that  is  stochastic  in  the 
disturbance  space  (i.e.,  external  uncertainties)  and  deterministic  in  the  parameter  space 
(i.e.,  internal  uncertainties).  By  “internal  uncertainties”  we  have  in  mind  quantities 
such  as  mass,  damping,  or  stiffness;  by  “external  uncertainties”  we  are  referring  to 
phenomena  such  as  turbulent  flow  for  which  only  power  spectrum  statistics,  may  be 
available.  No  claim  is  made,  however,  with  regard  to  the  universal  validity  of  such  a 
mathematical  uncertainty  model.  In  particular  applications,  uncertainty  models  that 
are  either  wholly  deterministic  or  wholly  stochastic  may  be  more  appropriate.  In 
general,  our  setting  appears  to  be  consistent  with  the  available  literature  (see  [l]-[28]). 

1.4.  Performance  bound.  To  obtain  a  tractable  design  problem,  we  use  the  matrix 
to  bound  the  performance  of  each  controller  solving  the  Robust  Stability  Problem. 

Specifically,  by  assuming  in  addition  to  (1.4)  that 

(1.9)  i  aAAl 9  +  S?>i,)  +  R^a{9,  B„  C), 
it  follows  that 

(1.10)  J(/l„B„C,)str0>V. 

In  (1.9)  and  (1.10)  R  and  V  denote  closed-loop  weighting  and  disturbance  intensity 
matrices.  The  idea  of  bounding  the  performance  by  means  of  a  Lyapunov  function  is 
the  basis  for  guaranteed  cost  control  [14],  [17].' 

1.5.  Construction  of  the  Lyapunov  function.  So  far  the  Lyapunov  function  has  only 
been  abstractly  characterized  by  means  of  (1.3)  and  (1.4).  To  obtain  a  useful  design 
theory  Cl  is  now  given  a  concrete  form.  Specifically,  to  satisfy  (1.9;  it  is  assumed  that 

(1.11)  il(P,  Be.  Ce)=  i  A,(£?,  Be.  Ce)  +  R, 

/-I 

where,  for  each  ;,  the  A,  are  chosen  such  that 

(1.12)  cr,(Aj'^  +  ^A,)£A,(ff^.Be.Ce), 


'  It  i&  alio  interesting  to  note  that  in  Hamilton-iacobi- Bellman  suIHcienC)  theor>  the  performance 
funuiunal  is  expressed  in  terms  of  a  value  function  that  also  serves  as  a  Lvapunov  function  for  the  closed  loop 
system.  These  connections  will  be  explored  in  a  future  paper. 
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Note  that  (L12)  implies  that  (1.4)  holds  withll  given  by  (1.11).  Since  A,  depends  on 
Be  and  Q,  the  bound  A,  will  be  constructed  to  be  i-ain-invariant,  that  is,  so  that  (1.12) 
holds  for  all  Be  and  Q.  Thus  no  difficulty  will  arise  from  the  faa  that  the  controller 
gains  are  yet'Jto  be  determined  by  optimality  considerations. 

It  should  be  noted  that  the  bounding  itt'(r.l2)  is  defined  in  the  sense  of  the  cone 
of  nonnegative  definite  matrices.  Since  this  is  only  a  partial  ordering  and  not  a  total 
ordering,  a  least  upper  bound  (i.e.,  a  “sharpest”  bound)  docs  not  exist  in  general  and 
the  conservatism  of  the  inequality  in  (1.12)  cannot  be  quantified  by  a  scalar  measure. 
Hence,  Aj  satisfying  (1.12)  is  not  necessarily  unique  and  two  particular  choices  of  Aj 
are  developed  in  this  paper.  Since  we  shall  utilize  first-order  necessary  conditions  for 
optimality,  we  confine  our  consideration  to  bounds  that  are  differentiable.  The  first 
choice  of  A,-  satisfying  (1.12)  is  given  by  the  linear  (in  S*)  function 

(1.13)  A!iS>,  Be,  Ce)  =  +a7' AT 0>A,), 

where  or,-  is  an  arbitrary  positive  number.  As  shown  in  [33],  the  bound  (1.13)  can  be 
viewed  as  arising  from  a  stochastic  optimal  control  problem  with  exponentially  weighted 
cost  and  state-,  control-  and  measurement-dependent  white  noise.  The  stochastic 
multiplicative  white  noise  model  serves  only  as  an  interpretation,  however,  and  need 
not  be  viewed  as  having  physical  significance.  A  similar  bound  is  used  in  [28]. 

The  s-cond  choice  for  Ai  satisfying  (1.12)  is  given  by  the  quadratic  (in  0>)  function 

(1.14)  Aii9,  Be,Ce)  =  S,{ETEi  +  mDTg^), 
where  D,,  Ei  denote  an  arbitrary  fartorization  of  A,-  of  the  form 

(1.15)  Ai  =  D,E,. 

The  bound  (1.14)  was  used  in  [26]  for  full-state  feedback  with  rank  1  uncertainties. 
Note  that  using  congruence  transformations-.shows  that  both  bounds  (1.13)  and  (l.j4) 
are  basis  independent;  that  is,  replacing  A,  by  SA,S"*  leads  to  replacing  ^  by 

1.6.  Auxiliary  Minimization  Problem.  The  next  step  in  our  development  for  robust 
performance  is  the  following.  Inasmuch  as  the  performance  of  a  robustly  stabilizing 
controller  is  bounded  via  (1.10)  over  the  given  range  of  parameter  variations,  it  is 
desirable  to  minimize  the  upper  bound 

(1.16)  ^{9,Ae,Be,Ce)^lr9V 

subject  to  the  constraint  (1.3).  This  is  referred  to  as  the  Auxiliary  Minimization  Problem. 
For  a  given  choice  (1.13)  or  (1.14)  of  A,-  for  each  f,  a  solution  of  the  Auxiliary 
Minimization  Problem  provides  a  controller  whose  steady-state  performance  is  guaran¬ 
teed  to  remain  below  the  bound  (1.16)  over  the  range  of  parameter  variations,  hence 
guaranteeing  robust  performance.  Since  the  Auxiliary'  Minimization  Problem  is  a 
smooth  mathematical  programming  problem,  a  minimum  always  exists  on  compact 
sets.  To  actually  characterize  extremals  of  the  Auxiliary  Minimization  Problem  we 
proceed  by  deriving  first-order  necessary  conditions.  Because  these  necessary  conditions 
are  derived  for  the  Auxiliary  Minimization  Problem,  they  effectively  serve  as  sufficient 
conditions  for  robustness  in  the  original  problem. 

It  should  be  noted  that  the  guaranteed,  cost  control  approach  developed  in  [14] 
does  not  permit  this  line  of  development  since  Ai  is  given  by 

A,(&>,Be,Ce)  =  S,\Aj9  +  g^A,\, 


(1.17) 
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where  j-l  denotes  the  matrix  obtained  by  replacing  each  eigenvalue  by  its  absolute 
value.  Since  this  bound  is  not  differentiable  with  respect  to  the  controller  gains, 
first-order  necessary  conditions  cannot  be  used. 

1.7.  The  optimality  conditions:  full-order  case.  For  the  full-order  case,  i.e.,  when 
the  order  of  the  controller  is  equal  to  the  order  of  the  plant,  the  first-order  necessary 
conditions  can  be  derived  in  a  form  that  is  a  direct  generalization  of  the  pair  of 
separated  Riccati  equations  of  LQG  theory.  Specifically,  the  necessary  conditions 
comprise  a  coupled  system  of  four  algebraic  matrix  equations  including  a  pair  of 
modified  Riccati  equations  and  a  pair  of  Lyapunov  equations.  For  plant  models 
involving  multiplicative  white  noise  these  equations  have  been  studied  in  [34]-[36]. 
This  form  of  the  equations  thus  essentially  corresponds  to  choosing  bound  (1.13). 

1.8.  The  optimality  conditions:  reduced-order  case.  For  design  flexibility  we  also 
consider  controllers  of  arbitrary  reduced  dimension.  For  the  linear-quadratic  problem 
without  parameter  uncertainty,  the  formulation  of  the  necessary  conditions  given  in 
[29]  provides  a  generalization  of  LQG  theory.  Specifically,  the  optimal  gains  are 
characterized  by  a  system  of  algebraic  matrix  equations  consisting  of  a  pair  of  modified 
Riccati  equations  and  a  pair  of  modified  Lyapunov  equations  coupled  by  an  oblique 
projection.  When  the  order  of  the  controller  is  equal  to  the  order  of  the  plant,  the 
projection  becomesnhc  identity  and  the  standard  LQG  result  is  recovered. 

The  outcome  of  the  development  above  is  a  set  of  algebraic  matrix  equations  that 
correspond  to  the  necessary  conditions  for  the  Auxiliary  Minimization  Problem  and 
hence  to  sufficient  conditions  for  robust  stability  and  performance.  These  necessary 
conditions  charaaerize  full-  or  reduced-order  controllers  with  either  choice  of  bounds 
(1.13)  and  (l.H)  for  each  uncertain  parr.meter.  For  control-system  design,  these 
equations  can  be  used  as  follows.  If  a  solution  to  the  necessary  conditions  is  obtained 
computationally  and  if  certain  definiteness  conditions  hold,  then  the  explicitly  synthe¬ 
sized  controller  ( 1 )  solves  the  Robust  Stability  Problem  and  (2)  is  guaranteed  to  provide 
robust  performance  bounded  by  tr9V  over  the  stipulated  uncertainty  range. 

The  applicability  of  these  results  is,  of  course,  limited  to  plants  that  are  nominally 
stabilizable  via  controllers  of  the  given  order.  Indeed,  in  this  case  it  has  been  shown 
[37]  via  topological  degree  theory  that  the  optimality  conditions  for  the  case  S,  =  0, 
/  =  1 ,  •  •  • ,  p,  possess  at  least  one  stabilizing  solution.  For  the  parameter  uncertainty 
problem,  i.e.,  8i  >  0,  it  follows  from  continuity  properties  that  a  solution  also  exists 
for  sufficiently  small  5,.  The  actual  range  of  uncertainty  that  can  be  stabilized  and  the 
tightness  of  the  performance  bound  depend  on  the  conservatism  of  our  bounds.  As 
will  be  seen  from  a  numerical  example,  our  bounds  are  not  generally  sharp.  This  is 
not  unexpected,  however,  due  to  both  the  sense  of  the  partial  ordering  employed  in 
(1.12)  and  the  fact  that  our  choice  of  gain-invariant  bounds  permits  a  one-step, 
noniterative  synthesis  (rather  than  analysis)  procedure.  It  should  be  noted  that  necessary 
and  sufficient  conditions  for  robust  analysis  of  a  block-structured  class  of  uncertainties 
are  obtainable  using  the  ^.-function  [6].  This  block  structure,  however,  does  not  appear 
to  include  either  the  linear  uncertainty  model  (1.1)  or  the  matched  uncertainty  model 
of  [21]  as  special  cases. 

In  the  present  paper  we  present  results  of  an  illustrative  numerical  study  for  a 
well-known  example  used  in  [2]  to  demonstrate  the  lack  of  gain  margin  for  LQG 
controllers.  This  type  of  uncertainty  is  a  special  case  of  (1.1)  obtained  by  taking 
p-m  and  defining  B,  to  be  the  matrix  whose  ith  column  is  the  same  as  the  ith  column 
of  B,  and  zero  otherwise.  To  obtain  full-order,  robustified  controllers  exhibiting  perfor¬ 
mance/robustness  tradeoffs,  we  use  bound  (1.13)  for  several  values  of  5j.  To  obtain 
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these  numerical  results  we  used  a  straightforward  iterative  algorithm  that  requires  only 
an  LQG-type  software  package.  The  homotopy  algorithm  of  [37]  with  appropriate 
extensions  can  also  be  used.  Funher  descriptions  of  related  algorithms  and  numerical 
results  can  be  found  in  [38]-[40]. 

The  development  herein  is  self-contained,  with  the  e,xception  that  the  detailed 
derivation  of  the  optimality  conditions  has  been  omitted.  In  specialized  cases  the 
derivation  has  been  given  previously.  For  the  case  of  bound  (1.13)  only,  a  derivation 
using  Kronecker  products  appears  in  [36].  Also,  a  derivation  without  parameter 
uncertainties  has  been  given  in  [29]  using  Lagrange  multipliers.  Overall,  the  derivation 
involves  considerable  matrix  manipulation.  Since  the  detailed  derivation  does  not 
appear  to  warrant  the  required  space,  we  give  an  outline  of  the  proof  to  assist  the 
sufficiently  motivated  reader  in  reconstructing  the  details. 


2.  Notation  and  definitions.  (Note  that  all  matrices  have  real  entries.) 


I,  E 


tr 

S' 

P' 

Z.aZi 
Z|  ^  Zj 


real  numbers,  rxs  real  matrices,  R'*', 

expectation 

Euclidean  vector  norm 

rxr  identity  matrix,  rxs  zero  matrix,  0,xr 

transpose,  inverse,  inverse  transpose 

trace 

Kronecker  sum,  Kronecker  product  [41] 

rxr  symmetric  matrices 

rxr  symmetric  nonnegative-deiinite  matrices 

rxr  symmetric  positive-definite  matrices 

Z,-Z,€N',  Z,,Z,eS' 

Z,-Z,6P',Z„Z;e§' 


asymptotically  stable  matrix  matrix  with  eigenvalues  in  open  left  half-plane 


n,  m,  /,  p,  n„  n,,  m, 
n,n, 

X,  u,y,x^ 

A,  A,;  B,  Br,  C,  Q 

A„  Be,  Ce 
A,  A, 


o(-) 

i.*{(0,oo),A) 


Di,  £|,  Hi,  Ki 


D„E. 

r.r 

Rx 


positive  integers,  ie {1,  •  •  • , p] 

n  +  n^tti-rm,, 

n,  m,  /,  Uc-dimensional  vectors 

nxn  matrices,  nxm  matrices,  / x n  matrices, 

/e{l,---,p} 

n^XHe,  fieXl,  m  X 17^  matrices 

positive  number,  ie (I,  ■  •  • , p] 

[-5,,5,]x  -  •  •x[-6p,5p] 
real  number,  ie{l,  —  ,p} 

(o-,,---,trp) 

Lebesgue  measurable  function  on  [O.co),  ie 

(^i('),-  •  •.^p(-)) 

Lebesgue  measurable  functions  on  [0,  co)  with 
values  in  A 

positive  number,  /  e  {1,  •  ■  • ,  p} 
n  X Hi, nixn,nx mi,  ttiiXm  matrices, 

n  X  ri|,  m  X 11  matrices,  « e  {1,  •  •  • ,  p) 
see  §6 

state  weighting  matrix  in  N" 
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R2 

control  weighting  matrix  in  P" 

Ri2 

n  X  m  cross  weighting  matrix  such  i 
Ri-Ri2RVRI2^0 

R 

r  R,  R,2C,  1 

Lcf/tr:  CjR,cJ 

«',(■) 

n-dimensional  white  noise 

H'2(-) 

/-dimensional  white  noise 

V, 

intensity  of  w,(-)  in  W" 

V, 

intensity  of  W2{  • )  in  P* 

V,2 

nxl  cross-intensity  of  h',(  • ),  w'2(  • ) 

(■  1'.  ] 

IbXi 


3.  Robust  Stability  and  Robust  Performance  Problems.  In  this  section  we  state  the 
Robust  Stability  Problem  and  Robust  Performance  Problem  along  with  related  notation 
for  later  use. 

3.1.  Robust  Stability  Problem.  For  fixed  n^^n,  determine  (/!,,  B,,  Q) € 
xR"'"' such  that  the  closed-loop  system  consisting  of  the  nth-order 
controlled  plant 

(3.1)  x(t)  =  ^A-rY.  ^iii)A^xU)  +  ^B+Z  a.a. r e [0, oc). 


measurements 

(3.2) 


y(t)  =  {^C+i&,{i)C^xU), 


and  n^th-order  dynamic  compensator 

(3.3)  xAn=-A,xAl)  +  B,y{i), 

(3.4)  u(t)  =  QxAi) 

are  asymptotically  stable’  for  all  <?(•)€  Lx([0,  oo).  A). 

3.2.  Robust  Performance  Problem.  For  fixed  n,  §  n,  determine  (A,,  B„  C,)  6 
R"-’'”  xR"’‘'xR'"’‘"  such  that,  for  the  closed-loop  system  consisting  of  the  nth-order 
controlled  and  disturbed  plant 

(3.5)  :c(f)  =  ^/i+I  ^iiOA^xiO-i-^B-i-T  aj(r)B,^  u(r)  + w,(/)  a.a.  t s [0, co). 


noisy  measurements 

(3.6) 


y(0  =  ^C+  I  &i{i)C^x{i)-i-w,{i), 


and  n^th-order  dynamic  compensator  (3.3),  (3.4),  the  performance  criterion 
J{A„  B„  O 

(3.7) 

^  sup  limsupE(x^(Of2i-'t(t)+2.v’’(f)R, ;«(/)+ u^(/)Riii(f)] 

iJl.J€t,lfO.Xl.A»  f-Jt 

is  minimized. 

'  Asympiotic  siabiliiy  for  a  nonautonomous  system  is  defined  in  the  standard  way  (see,  e.g.,  [42]). 
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For  each  controller  {Ae,  Q )  and  parameter  variation  a(’)e  L«([0,  oo),  A)-the 

undisturbed' closed-loop  system  (3.1)-(3.4)  is  given  by 

(3.8)  x(t)  =  (^A+Z  ^liOA^^xit)  a.a.  /e[0,oo), 
while  the  disturbed  closed-loop  system  (3.3)-{3.6)  is 

(3.9)  x(t)  =  ^A-J- 1  <?,(/)i4,^x(r)+v5(r)  a.a.  r e [0, oo). 

Also  (see,  e.g.,  [43,  p- 194]),  let  ❖  :[0,oo)->R"’‘"  be  the  unique  absolutely  continuous 
solution  to 


(3.10) 


$(0  =  ^A-l- 1  ^,(t)A;y$(f)  a.a.  r6[0,oo), 

(3.11)  ^(0)  =  /„-, 
and  recall  that  $”'(•)  satisfies 

(3.12)  j^^-\t)  =  -^-\t)(A+iaMA^  a.a.f6[0,co). 

4.  Sufficient  conditions  for  robust  stability  and  performance.  For  robust  stability 
we  characterize  quadratic  Lyapunov  functions  for  the  closed-loop  system. 

Theorem  4.1,  Let  ft  :P"xR"-’‘'x ^§"  satisfy 


P 

I 

im 


I  <r,(Ar^-rS?A,)<ft(^,  Q),  tre  A, 


(4.1) 

Q)eP"xR".''xR"”‘\ 

If,  for  some  (A„  J?<,  Cf)eR"*’‘"  xR"'’‘'xR’”’‘",  there  exists  ^eP"  satisfying 

(4.2)  0  =  A^S^+9>A+ili9^,B„C,), 

then  (A„  Q)  solves  the  Robust  Stability  Problem. 

Proof.  Define  the  Lyapunov  funaion 

V(.v)A.xV;^  xeR". 

For  almost  all  t  e[0,oo)  and  .v(t)  satisfying  (3.8),  it  follows  from  (4.2)  that 
V(jc(/)) = :c^(0^.x(f) -5- x’’(r)^.v(r) 


=.x^(t)[  I  a,{t)(AT9>^9A,)-a{9,  Q)]x(r). 


Since  <?(/)e  A,  almost  all  te[0,oo),  it  follows  from  (4.1)  that  there  exists  y>0  such 
that  V'(.'c(0)  =  -7flx(t)II%  almost  ail  te(0,co).  D 

Remark  4.1.  If  (A„  Q)  solves  the  Robust  Stability  Problem,  then 

(4J)  lim^(0=0,  a(-)6L.([0,oo).A). 


Remark  4.2.  As  will  be  seen,  the  bound  (4.1)  will  be  guaranteed  for  ail  5*,  B,,  C, 
by  suitable  construction  of  the  function  ft.  In  addition,  the  existence  of  a  solution  3^ 
to  (4.2)  need  not  be  verified  in  practice.  Rather,  (4.2)  is  a  result  of  numerically  solving 
the  necessary  conditions  for  the  Au.xiliary  Minimization  Problem  given  in  Theorem  6.1. 
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For  the  Robust  Performance  Problem  the  cost  can  be  expressed  in  terms  of  the 
closed-loop  second-moment  matrix. 

Proposition  4.1.  For  (/4,,  B,,  and  (t(  • )  6  l=c([0.  «>),  A) 

the  second-moment  matrix 

(4.4)  <e[0,oo), 
satisfies 

(4.5)  Q{t)  =  (^A+i&,{t)Ai^Q(t)  +  Q(t)(^A+i^&i{t)A^  +V  a.a.  t  e[0,co), 
or,  equivalently, 

(4.6)  <?(/)  =  «»(0Q(0)4"'(t)+[  Mt)^~\s)Vi>-'^{s)^'^{t)ds,  t6[0,oo). 

Jo 

Furthermore, 

(4.7)  . 


J(Ac,Bc,Ct)=  sup  limsuptr(?(f)^ 

^(■)€L«j([0.<»).A)  /-oo 


or,  equivalently. 


(4.8) 


JiA„Bt,Cc)-  sup  limsuptrj  d'(f)Q(0)ij>^(t)R 

<;(-)e£.®<(0,<»).A)  <-00 


itr  j^< 


■f  ^(t)^-'{s)Vi-'^{s)i'^(t)dsR  . 

Jo 


Proof.  The  second-moment  equation  (4.5)  is  a  direct  consequence  of  the  Ito 
differential  rule  (see  [44,  p.  142]),  while  (4.6)  follows  by  direct  verification.  Finally, 

(4.7)  is  immediate.  0 

We  now  obtain  an  upper  bound  for  J  in  terms  of  the  matrix  0*.  The  following 
lemma  is  required. 

Lemma  4.1.  Let  ^§"  and  (<4,,  B,,  OeR"-’"’- xR"-’''  x 

R""‘”  be  given.  Then  satisfies  (4.2)  if  and  only  if  satisfies 

S»  =  4'’'(t)S?4>(t)+ I  4'^(r)4>’'^(j) 

Jo 

(4.9)  -^£1(9,  B„  fi,it)iAT9  +  9A,)^^-\sWt)  ds, 

<r(-)eL«,([0,oo),A),  t6[0,c»). 

Proof.  Suppose  9  satisfies  (4.2).  Then  for  l  €  [0,  oo), 

0  =  ^-^{t)(^A+i  &i(t)A^  9^-'it)  +  ^-'^{t)9(^A+i^  &,{t)A^i-'it) 

+  4>-^(/)  [^fi(gP,  B„  CJ-  i  aM{AT9+9A,)^  $"'(/) 

=  -jl^^-'^it)9i-'{t)^+^-^{t)^ni9,B,,Cc)-i&i{t){AT9  +  9Ai)^i-\t), 

which  yields 

0  =  -^~^{t)9^~'(t)  +  9 

+  j’ d>-''(j) [^n(g^,  B„  C,)-i  &,{s){Aj9  +  9Ar)^^-'{s)  ds. 
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Tlius  (4.9)  is  satisfied.  Conversely,  suppose  0*  satisfies  (4.9),  Differentiating  with  respect 
to  t  using  Leibniz’s  rule  yields 


n(^, 


Be,  0-1  &i(s)(Ar&>  +  &‘Ai)  ^-'is)Mt)ds 

•  “1 


•  a(9,  Be,  O-  i  &m(aT0>+9>A,) 

Jo  L 


+  n(^.  Be,  Ce)-  i  <J,(/)(Ar^  +  ^A) 

i-*l 


=  (a+  i  9  +  ^(^A+  i  (tKOa)  +n{g^,  B„  Ce)-  i  a.(f)(A?'&>  +  g?A) 

=  ,4’’5»  +  ^A  +  n(^,  Be,  Ce). 

Hence  (4,2)  is  satisfied.  □ 

Remark  4.3.  Note  the  identity 

tr  [  <j>(r)$-'(s)i^$-'^(s)4)^(r)dsB  =  tr  I  ^'^(t)^-'^(s)R^~'(s)Mt)  ds  V, 

(4.10) 

(A,  Be.  O  €  X  X  R"”*".,  <?(•)€  L«([0,  CO),  A)',  r  e  [0,  co). 

We  are  now  in  a  position  to  bound  the  cost  J  by  means  of  the  matrix  0*. 

Theorem  4.2.  Let  Cl:P"  xU"'"''  xR"”'"-  ^S"  satisfy  (4.1)  and 

t  trfAj' SP  +  S»A)  +  R^fl(0>,  Be,  Ce),  o- e  A, 

(4.11) 

(^,B„  Ce)€P''xR'’«’‘'xR"”‘"<. 

//  for  some  (.4e,  Be,  Ce)  e  R"*’^”'  x  x  R'”’'"*,  there  exists  ^  6  P"  satisfying  (4.2),  r/ie/J 

(4.12)  y(A,Be,Ce)gtr0>K 
Proof.  From  (4.8)-(4.10)  and  (4.3)  it  follows  that 

J(A„  Be,  Ce) 

=  sup  limsuptr|4(/)Q(O)4>^(/)B  +  ^V-$^(/)0*5>(r)  V 

-|  0"'(r)$-’'(5)[D(^,Be,Ce)-B-I  d,{s)(ATSf>  +  ff>A,)]^^-'(s)i>(t)dsV^ 
g  sup  limsuptr[4'(r)(?(0)^^(r)B  +  ^V'] 

</(•)?  r.T((0.oo).A)  (.•00 

=  trS»V'. 
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Remark  4.4.  Note  that  since  R^O,  (4.11)  implies 
(4.13)  i  (r,(A?'^  +  ^A,)sn(0»,B„Q),  trsA, 

/•I 

which  is  a  weak  form  of  (4.1).  If  R>0  then  (4.11)  implies  (4.1).  This  implication  is 
not  surprising  since  (4.11)  implies  robust  performance  while  (4.1)  implies  robust 
stability. 

5.  Choice  of  bounds.  To  satisfy  (4.11),  fl(-,  •,  •)  is  chosen  to  be  of  the  form 

(5.1)  n(g?,  C)  =  i  Cc)  +  R, 

I*  I 

where,  for  each  i  =  l,  •  •  •  ,p,  satisfies 

<r,(ArS»  +  ^A)gA,(^,B„Q),  cr..e[-6„6,]. 

(§>,  O  €  P"  X X 

Two  distinct  choices  for  the  bound  A,  are  considered.  As  >ye  pointed  out  in  §  1,  the 
first  choice  corresponds  to  a  right  shift/multiplicative  white  noise  model  [33],  while 
the  second  bound  generalizes  results  found  in  [26]. 

Proposition  5.1.  For  all  a(>0  the  function 

(5.3)  A,(^,  Be.  Ce)  =  5.(a,#  +  a7'Ar^Ar) 

satisfies  (5.2). 

Proof.  Note  that 

which,  since  erj  g  Sj,  implies  (5.2).  □ 

Proposition  5.2.  For  all  AeR"’*"'  and  £,eR"'’‘"  satisfying 

(5.4)  A,  =  D,E„ 
the  function 

(5.5)  A.(SP,  Be,  C,)  =  8AEJE;  +  0>DiDJ§>) 

satisfies  (5.2). 

Proof.  Note  that 

0  g  [5i-'''£,  -  (r,5V'"^DT  ef^flS'/'E,  -  9] 

=  5iEl  £,  +  icri/diWiDf  9  -  or,{Aj  9  +  ^A^, 
which  implies  (5.2).  0 

6.  The  auxiliary  ntinimization  problem  and  necessary  conditions  for  optimality.  To 
optimize  robust  performance  while  retaining  robust  stability,  we  consider  the  following 
problem  for  which  the  cost  functional  is  given  by  the  bound  (4.12). 

6.1.  Auxiliary  Minimization  Problem.  For  i  =  1,  •  ■  •  ,p,  let  A;  be  given  by  either 
(5.3)  or  (5.5).  Determine  (S^,  A„  B„  C,)eP"xlR".’‘"'  x(R"-’''xlR"”'%  which  minimizes 

(6.1)  j?(g?,A„B„C)^trg?F 


0 
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subject  to 

(6.2)  0  =  +  (9^^+  S  Ai(^,  Be,  Ce)  +  ^ 

I- 1 

(6.3)  i  (ri(A[0>  +  §>A!)<  i  A.(^,  B^,  Q)  +  ^  ere  A. 

<-i  <-i 

Remark  6.1.  Note  that  (6.3)  enforces  both  (4.1)  and  (4.11)  to  guarantee  robust 
stability  and  performance. 

To  derive  first-order  necessary  conditions  for  the  Auxiliary  Minimization  Problem, 
note  that  the  constraint  (6.3)  defines  an  open  set. 

Proposition  6.1.  The  set  of  {9^,  Be,  Cg)  eV" satisfying  (6.3)  isopen. 
Proof.  Since  A(( •,*,•)  is  continuous  it  can  be  shown  that  the  function 

/(S?,Be,Ce)^minA„i„f  £  Bg,  Ce)  + R- 1  cr,{ArS/>  +  9Ad] 
li-i  f-i  J 

is  also  continuous.  Since  (6.3)  is  equivalent  to  0<f{9,  Bg,Cg),  the  result  is 
immediate.  □ 

To  obtain  explicit  feedback  gain  expressions  we  shall  require  two  additional 
technical  assumptions.  If  bound  (5.3)  is  chosen  for  a  given  ie{l,  •  •  •  ,p}  we  require 

(6.4)  B.-#0=»C,  =  0, 

i.e.,  B,  and  C,  are  not  simultaneously  nonzero.  Of  course,  both  B,  and  C,  may  be  zero. 
Assumption  (6.4)  implies  that  parameter  uncertainties  in  B  and  C  must  be  modeled 
as  uncorrelated.  Correlation  between  uncertainties  in  A  and  B  or  A  and  C  is,  of 
course,  permitted.  Furthermore,  if  bound  (5.5)  is  chosen  for  a  given  i6{l,  •  •  •  ,p}  we 
require 

(6.5)  C,  =  0. 

We  stress  that  (6.4)  and  (6.6)  can  be  removed,  but  at  the  expense  of  explicit  gain 
expressions. 

When  we  use  bound  (5.3)  the  positive  constant  a,  will  be  considered  fixed  but 
arbitrary.  Furthermore,  for  bound  (5.5),  let  D/SR"’"’*,  E.-elR"'’''’,  //ieR"’*'"',  and  KiB 
R'"'’*'”  satisfy 

(6.6)  ■  A.  =  D,E„  B,  =  H,A:,., 

and  define  Di,  Ej  satisfying  (5.4)  by 


In  addition  to  the  open  set  defined  by  (6.3),  the  derivation  of  the  necessary  conditions 
requires  that  (9,  Ag,  Bg,  Cg)  be  further  restricted  so  that 

(a+^E'  Wn+I"  0iDT9>^ 

(6.8)  ,  .  -  - 

+E  (5, Of/  )Ai®Ai  is  asymptotically  stable, 

(6.9)  (Ag,  Bg,  Cg)  is  controllable  and  observable. 

In  (6.8)  the  notation  E"  and  E"  denotes  summation  over  indices  for  which  bounds 
(5.3)  and  (5.5),  respectively,  have  been  chosen.  Note  that  (6.8)  and  (6.9)  play  no  role 
in  the  Auxiliary  Minimization  Problem  and  thus  need  not  be  verified  for  robust  stability 
or  robust  performance. 
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For  arbitrary  Q,  P,  (?,  PelR"*'"  define  the  following  notation: 

R2a  =  R2+l’iS,aT')BriP+P)B,+r  S>KTk>, 

V2a^V^+l'  {8,a7')Q{Q+Q)Cr, 

PAB'^P  +  Rl2+I.'iS^c,T')Br{P+P)Ai, 
Qa^QC'^+V^,+r{S,aT^)A,{Q  +  Q)CT, 

D^r  s,iD,Dr+H;Hr),  E^r  s,ete>, 

A^A+^l' S.aJ„,  Ap^A-BR7^P,,  Aq^A-Q^V^^C. 


The  following  lemma  will  be  needed. 

Lemma  6.1.  IfQyPsN"  and  rank  QP  =  /ij.,  then  there  exist  G,  F  6  R"*’*"  and  invert¬ 
ible  M  eR"’'"-  such  that 

(6.10)  QP  =  G^Mr, 

(6.11)  rG’'=/„^. 

Furthermore,  G,  M,  and  F  are  unique  except  for  a  change  of  basis  in  R" . 

Proof.  The  result  is  an  immediate  consequence  of  [45,  Thm.  6.2.5,  p.  123].  □ 

Note  that  because  of  (6.11),  the  nxn  matrix  t  =  G^F  is  idempotent,  i.e.,  t^  =  t. 
Since  r  is  not  necessarily  symmetric,  it  is  an  oblique  projectiqn.  Also,  define  t. 

Theorem  6.1.  Suppose  (^,  A,,  B,.,  C,)  solves  the  Auxiliary  Minimization  Problem 
subject  to  (6.8)  and  (6.9).  Then  there  exist  P,  Q,  P,QzH"  such  that  0*,  A^,  P„  C  are 
given  by 


p+p  ..pc^ 

L-gp  gpg^J’ 


(6.13)  A,  =  F(A  -  (?„  VjjC  -  PPjj  P„  +  DP)G\ 

(6.14)  Pc  =  r(?„v;j, 

(6.15)  C,  =  -R7lP,G\ 
and  such  that  P,  Q,  P,  Q  satisfy 

0  =  A^'P  +  PA  +  P,  +Z'  (5.ar')[Ar PA,  +  (A, -  Q,  Vjj C,)’'P( A, -  Q„  Vjj C,)] 

(6.16)  ^  ^  ^ 

+  £  +  POP  -  PjR7i  Pa  +  rlPl P  Jj  PaTj,  , 

0  =  [A+D(P  +  P)](?+(?[A+D(P+P)]’‘+y, 

(6.17)  +Z'  (6ia,"')[A,QA,r+(A,-£,PjjPjg(A,-B,PjjP„)^] 

-  Qa  VVa  Ql  +  r^QaV7l  QItT, 

(6.18)  0  =  (Ap  +  DP)^P  +  P(4  +  DP)  +  PDP  +  PjPjjP^  -rlPjPjjP^Tj,, 

(6.19)  0  =  (Ap  +  DP)Q  +  Q(An  +  DP)^+  g„  VjjQj  -  VJJqM, 

(6.20)  rank  <?  =  rank  P  =  rank  QP  =  n,. 
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Conversely,  if  there  exist  P,  Q,  P,QeM"  satisfying  (6.16)-(6.20),  then  given  by  (6.12) 
satisfies  (6.2)  or,  equivalently,  (4.2)  with  (Ac,  Be,  Q)  given  by  (6.13)-(6.15). 

Outline  of  proof.  As  discussed  in  §  1,  we  limit  the  presentation  of  the  proof  to  the 
salient  details.  First  note  that  with  the  choice  of  bounds  A(,  (6.2)  becomes 

o=(a+^I'W„-) 

-i-Z'  (S.a7')AT^A,+T  S,(EjE,  +  mDT^). 

By  introducing  multipliers  A  eR,  A  so,  and  2  eR”*'",  a  Lagrangian  can  be  defined  as 

(6.22)  ^(Sf,  Ac,  Be,  C)^tr[A^V+S(RHS  of  (6.21))]. 


Setting  dSg/d^*  =  0  and  using  (6.8)  implies  that  A  =  1  without  loss  of  generality,  3  s  o, 
and  2.  satisfies 

0  =  (a+^Z'  W„-+Z"  D.DrS^)  S  +  a  (a+|z'  8,af,+t' 

(6.23)  ,  ,  .  .  ■  “ 

+Z(S,a7')Ai2Aj  +V. 

The  remainder  of-the  derivation  is  exactly  parallel  to  the  techniques  utilized  in  [29] 
and  [36].  Briefly,  the  principal  steps  are  as  follows: 


Step  1.  Compute  dS£ldAc,  diE/dBc,  and  dS6ldCe. 

Step  2.  Use  (6.9)  to  show  that  the  lower  right  «<■  x  n,  blocks  of  2  and  ^  are 
positive  definite. 

Step  3.  Use  dSEjdAc  =  0  to  define  a  projection  t  and  new  variables  P,  Q,  P,  Q,  C,  F. 

Step  4.  Partition  (6.21)  and  (6.23)  into  six  equations  (l)-(6)  corresponding  to  the 
nxn,  nxne  and  x  n,  blocks  of  ^  and  2,  respectively. 

Step  5.  Use  (2)  and  (3)  to  solve  for  Ad  show  that  (5)  and  (6)  also  yield  A,,;  note 
that  with  Ac  now  given,  (3)  and  (6)  are  superfluous  and  can  be  eliminated. 

Step  6.  Manipulate  (1),  (2),  (4),  and'(5)  to  yield  (6.16)-(6.19). 

Step  7.  Show  that  Steps  4-6  are  reversible  so  that  (6.16)-(6.20)  are  equivalent  to 
(6.2)  or,  equivalently,  (4.2). 


By  enforcing  the  strict  inequalities  9*>0  and  (6.3),  solutions  of  (6.16)-(6.20) 
guarantee  robust  stability  with  a  .robust  performance  bound.  The  following  result 
follows  from  Theorem  4.1,  Theorem  4.2,  and  the  converse  of  Theorem  6.1. 

Theorem  6.2.  Suppose  there  exist  P,Q,P,Qef^"  satisfying  (6.16)-(6,20),  and 
suppose  that  (6;3)  and  ^>0  are  satisfied  with  (SP,  Ac,  Be,  Q)  given  by  (6.12)-(6.15). 
Then  the  compensator  Ac,  Be,  Cc  given  by  (6.13)-(6.15)  solves  the  Robust  Stability  Problem 
and  the  closed-loop  performance  (3.7)  satisfies  the  bound 

(6.24)  J(Ac,B„Cc)StrS»V. 


The  following  existence  result  concerns  the  solvability  of  (6.16)-(6.20).  Let  «„ 
denote  the  dimension  of  the  unstable  subspace  of  the  plant  dynamics  matrix  A. 

Theorem  6;3.  Assuming  ne^nu,  Ri>0,  V,  >0,  suppose  the  nominal  plant,  i.e., 
(3.1),  (3.2)  With  S,  =  0,  I  =  1,  •  •  •  ,p,  is  stabilizable  and  detectable  and,  in  addition,  is 
stabilizahle  by  means  of  an  Ucth-order  strictly  proper  dynamic  compensator  (3.3),  (3.4). 
Then  there  , exist  6, ,  •  ■  ■ ,  3^  >  0  such  that  if  5(  e  [0,  6/),  i  =  1,  •  •  • ,  p,  then  (6.16)-(6.20) 
have  a  solution  P,  Q,  P,  for  which  (Ac,  Be,  Cc)  given  by  (6.13)-(6.15)  solve  the 
robust  stability, problem  with  robust  performance  bound  (6.24)i 
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Proof.  From  Theorem  3.1  of  [37]  it  follows  that  there  exists  a  solution  to  (6.16)- 
(6.20)  that  stabilizes  the  nominal  plant.  By  continuity  there  exists  a  neighborhood  over 
which  robust  stability  with  performance  bound  (6.24)  holds.  0 

Theorem  6.3  is  an  existence  result  that  guarantees  solvability  of  the  sufficiency 
conditions  over  a  range  of  parameter  uncertainties.  The  actual  range  of  uncertainty 
that  can  be  bounded  and  the  conservatism  of  the  performance  bound  are  problem 
dependent.  To  this  end  we  now  consider  a  numerical  example. 

7.  Illustrative  numerical  example.  To  demonstrate  the  theory  above  we  present  an 
illustrative  numerical  example.  The  example  chosen  was  originally  used  in  [2]  to 
illustrate  the  lack  of  a  guaranteed  gain  margin  for  LQG  controllers.  This  example  was 
also  considered  in  [35]  for  a  preliminary  robustness  study  and  reconsidered  in  [46] 
using  yx-analysis.  Define  the  following: 


Note  that  the  system  is  open-loop  unsl  ible  and  becomes  uncontrollable  at  or,  =  -l. 
As  can  be  seen  using  root  locus,  a  strict'y  proper  stabilizing  controller  must  be  of  at 
least  second  order.  Hence  we  consider  ( '.16)-(6.20)  with  nc  =  n  and  Tj.  =  0.  Further¬ 
more,  we  use  bound  (5.3)  and  thus  set  D  =  £  =  0.  Using  algorithms  described  in 


Fig.  I 
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Table  I 


(^1*  <*l) 

Be 

c.. 

(.1.1) 

[■-14.917  1.0  1 

L-85.177  3.9657J 

■i5.9:7‘ 

.79.959. 

[-5.2182  -4.9657] 

(-2.2)  1 

■-17.963  1.0  I 

.-133.65  -4.46I4J 

■  18.963’ 
.127.05. 

[-6.6011  -5.4614] 

(.4,4)  j 

■-47.813  I.O  I 

.-1087.3  -6.5463J 

■48.813’ 

.1073.5. 

[-13.766  -7.5463] 

[38]-[40],  controllers  were  obtained  by  solving  (6.16)-(6.20)  for  (5, ,  a,)  =  (.1, 1),  (.2, 2), 
and  (.4, 4).  As  stated  previously,  these  numerical  solutions  also  verify  (4.2)  with  ^ 
given  by  (6.12).  Figure  1  compares  the  guaranteed  robust  stability  region  to  the  "actual” 
robust  stability  region.  This  robust  stability  region  was  evaluated  assuming  constant 
CT,(-),  although  the  theory  actually  guarantees  robustness  with  respect  to  time-varying 
unceitainties.  Thus,  the  gap  between  these  regions  may  not  be  a  reliable  measjre  pf 
the  conservatism  of  the  results.  Note,  however,  that  the  design  approach  appears  to 
provide  mor"  stability  than  is  guaranteed  a  priori.  This  feature  may  be  attributable  to 
the  desire  for  a  symmetric  stability  interval  so  close  to  an  unstabilizable  plant  perturba¬ 
tion,  i.e.,  O',  =  -l.  Nevertheless,  the  stability  design  '’bjectives  hf've  been  met  in 
accordance  with  Theorem  6.2.  Interestingly,  the  fonn  uF  ine  actual  stability  region 
mimics  the  classical  6-dB-downward/infinite-dB-upward  gain  margin  of  full-state- 
feedback  LQR  controllers  [1].  Thus,  this  approach  appears  to  provide  an  alternative 
to  gain-margin  recovery  techniques  [9],  which  address  this  specialized  form  of  plant 
uncertainty.,Finally,  Fi^.  2  compares  guaranteed  closed  loop  performance  to  “actual” 
'  osed-loop  performance  over  the  guaranteed  closed-loop  robust  stability  region.  Again 
tne  "actual”  region  was  determined  for  constant  Controller  gains  are  given  in 
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Table  1.  Finally,  we  note  that  higher-order  robust  controllers  were  obtained  for  this 
example  in  [46]  using  the  /i-function  approach. 

Acknowledgments.  I  thank  Jill  M.  Straehla  for  prepari.ag  the  manuscript  versions 
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Wassim  M.  Haddad  for  several  helpful  suggestions,  and  the  reviewers  for  numerous 
helpful  comments. 
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Lyapunov  bound  suggested  by  recent  work  of  Petersen  and  Holjoi  is 
utilised  in  conjunction  with  the  guaranteed  cost  approach  of  Chang  and 
Peng  to  gusrsniee  robust  stability  with  robust  performance  bound. 
Necessary  conditions  which  generalize.the  optimal  projection  equations 
for  fixed-order  dynamic  compensation  arc  used  to  characterize  the 
controller  vrhich  minimizes  the  performance  bound.  The  design  equations 
thus  effectively  serve  as  sufficient  conditions  for  synthesizing  rfyiiamic 
output-feedback  controllers  which  provide  robust  stability  and  perform¬ 
ance. 

I.  INTRODUCTION 

As  is  well  known.  LQR  and  LQG  controllers  lack  guaranteed 
robustness  with  respect  to  arbitrary  parameter  variations  (11,  (2].  Thus,  it 
is  not  surprising  that  there  is  considerable  interest  in  the  analysis  and' 
synthesis  of  feedback,  controllers  which  are  robust  with  respect  to 
structured  real-valued  plant  parameter  uncertainty.  The  present  paper  wa:. 
motivated  in  particular  by  the  guaranteed  cost  control  approach  of  Chang 
and  Peng  [3],  [4]  and  tlie  robust  stability  technique  of  Petersen  and  Hollot 
(51-(7I.  In  [3],  Chang  and  Peng  consider  a  modified  Riccati  equation 
whose  solutions  are  guaranteed  to  provide  both  robust  stability  .and 
-performance  over  a  specified  range  of  parameter  variations.  On  the  other 
hand,  Petersen  and  Hollot  in  (S]-[7]  consider  a  different  modified  Riccati 
equation  which  utilizes  a  quadratic  Lyapunov  bound  to  provide  robust 
stability  over  a  range  of  structured  plant  variations,  in  the  present  paper, 
we  combine  aspects  of  both  of  these  approaches  to,  obtain  both -robust 
stability  and  performance. 

Our  preference  for  the  Petersen-Hollot  bound  over  the  bound  originally 
proposed  by  Chang  and  Peng  is  based  upon  the  fact  that  the  former  is 
differentiable  with  respect  to  the  Riccati  solution,  while  the  latter  is  not. 
We  exploit  this  smoothness  by  utilizing  the  optimal  projection  approach 
for,  fixed-order  dynamic  compensation  (8)  in  place  of  full-state  feedback 
considered  in  (3),  (4),  (6],  [7].  A  systematic,  in-depth  treatment  of- the 
Chang-Peng,  Petersen-Hollot;  and  other  bounds  (such  as  the  right  shift/ 
multiplicative  white  noise  bound  considered  in  [9)-[Il))  will  be  the 
subject  of  a  future  paper  (12), 

As  discussed  in  (8),  the  opiimaJ  projection  approach  to  fixed-order 
dynamic  compensation  is  based  upon  a  system  of  two.mbdified  algebraic 
Riccati  equations  and  two  modified  algebraic  Lyapunov  equations  which 
directly  generalize  LQG'-theory  to- the  case  of  reduced-order  controllers. 
To  ensure  robust  stability  and  performance  for  reduced-order  controllers, 
the  present  paper  utilizes  the  Petersen-Hollot  quadratic  Lyapunov 
technique  to  bound  the -performance  of  controllers  of  fixed  dimension. 
The  performance  bound  is  then  interpreted  as  the  cost  functional  for  an 
auxiliary  minimization  problem  whose  optimality  conditions  directly 
generalizeNthe  results  of  (8).  Specifically; 'wc' again  obtain  a  coupled 
system  of  algebraic  Riccati  and  Lyapunov  equations  with  additional  terms 
.arisiqg.'from  the  Petersen-Hollot  bound.  When  uncertainty  is  abKnt, 
these  equatfons  specialize  immediately  to  the  result  of  (8)  which;  in  turn, 
specializes  to  LQG  when  the  compensator  order  is. equal  to  the- plant 
dimension. 

Although  i.he  optimal  projection  equations  are  necessary  conditions  for 
optimality,  it  is  important  to  stress  that  in  the  present  paper  they  are 
obtained  not  for  the  original  cost  function,  but  rather  for  a  bound  on  the 
cost.  The  necessary  conditions  for  the  auxjliary  minimization  problem 
'Lhus  effectively  serve  as  sufficient  conditions  for  the  original  problem. 
Hence,  even  if  a  numerical  solution  of  the  extended  optimal  projection 
equations  fails  to  produce  the  globally  optimal  controller., robust  subility 
and  performance  are  still  guaranteed  for  all  local  extremals.  Our  approach 
thus  seeks  to  rectify  one  Of  the  main  drawbacks  of  necessity  theory  by 
guaranteeing  both  robust  stability  and  performance.  Nevcnhcless,  a 
numcncai'ojgonthm  for  computing  the  global  optimunt-is  given  in  (15). 

In  summary,  the  main  contribution  of  the  present  paper  is  the 
generalization  of  tne  optima!  projection  equations-by  means  of  the 
Petersen-Hollot  quadratic  Lyapunov  bound  to  synthesize  robustly 
stabilizing  fixed-order  dynamic  compensators  with  guaranteed  per¬ 
formance  bound.  It  is  interesting  to  note  that  even  jn  the  full-order  case, 
our  results,  which  specialize  to  a  coupled  system  of  three  matrix 
equations,  are  distinct  from  the  results  of  (5|  which  involve  a  pair  of 
modified  Riccati  equations  and  an  an.^iliary  inequality-  Furthermore,  the 
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present  paper  provides  a  robust  performance  bound  not  obtained  in  [Sj- 
[7J.  An  additional,  conceptual  benefit  of  our  approach  is  a  rigorous 
optimization  interpretation  for  the  Petersen-Hollot  Riccati  equation 
approach.  Finally,  as  shown  in  [20]  for  full-state  feedback,  the  results 
given  herein  can  be  directly  applied  to  the  design  problem.  For 
demils,  see  [21]. 

Due  to  space  constraints,  the  contents  of  the  paper  will  not  be  reviewed 
here.  We  note  only  that  the  proof  of  Theorem  8. 1,  which  hits  been  omitted 
for  this  reason,  can  be  found  in  [13],  [14].  Finally,  although  numerical 
algorithms  are  outside  the  scope  of  this  note,  related  results  can  be  found 
in  [15]. 

II.  notation  and  DEHNITIONS 
Note:  All  matrices  have  real  entries. 


noisy  measurements 

y(r)  =  (C+AC)x(r)+W2(r),  (3.6) 

and  «cth-order  dynamic  compensator  (3.3),  (3.4),  the  performance 
criterion 

J{Ac,  Be,  Cc)  =  sup  lim  sup  i[x^(t)RiX(t) 

+  2j«:’'(0/?i2«(0  +  u’’{0«2«(0]  (3.7) 

is  minimized. 

Remark  3.1:  Note  that  (3.7)  is  precisely  the  LQG  criterion  except  for 
the  supremum  over  'll  for  worst-case  performance. 

For  each  controller  (Ac,  Be,  Cc)  and  plant  variation  (NA,  AB,  AC)  € 
Tl,  the  undisturbed  closed-loop  system  (3.1)-(3.4)  is  given  by 


3,  W,  5 
/»()’■ 


Z|  £  Z2,  Zi  ^  Z2 

It,  m,  /,  n,;  n 
X,  u,  y,  Xc,  X 
A,  AA;  B,  AB;  C,  AC 

.4c,  Be,  Cc 

A,  AA 


Real  numbers,  r  x  s  real  matrices,  S'*', 
expected  value. 

r  X  r  identity  matrix,  transpose. 
r  X  r  symmetric,  nonnegative-definite, 
positive-definite  matrices. 

Z2  -  z,€  w,  Z2  -  z,e !?',  Zt,  Zi 
e 

Positive  integers;  n  +  «£. 

n,  m,  I,  tic,  ri-dimensional  vectors. 

n  X  n  matrices;  n  x  m  matrices;  t  x  n 

matrices. 

tic  X  tic',  tie  X  1;  m  X  tie  matrices. 


A 

BCe 

AA  ABCe 

BeC 

Ac  j  ' 

’  BeAC  0 

Ri,  Ri 


Rn 

W|{-),  Wj(-) 

y,2 
'  m, 


R 


n  X  n,  m  X  m  state,  control  weighting 
matrices;  Rx  ^  0,  Ri>  0. 
n  X  m  cross  weighting  matrix;  R|  - 
a  0. 

n,  f-dimensional  white  noise. 


Intensity  of  h'i(*),  w^f-); 

y,  z  0.  Pi 

n  X  1  cross  intensity  of  1 

ivil-).  WaC-)- 

r  ivK-) 

1  r 

1 

BeVlB!^} 

r  3. 

RnCe  1 

C^RiCei  ' 

i(0  =  (A  +  A/i)x(r),  t  e  [0, »).  (3.8) 

while  the  disturbed  closed-loop  system  (3.3)-(3.6)  is 

i(f)  =  (A  + AA)x(f)  +  tv(f),  r  e  [0,  00),  (3.9) 

where  ;f(/)  4  [x^(r),  a:J’(/)] ’’ and  w(-)  is  white  noise  with  intensity  I'  € 

R)^. 


rV.  SUFFICIENT  CONDITIONS  FOR  ROBUST  STABILITY  AND 
PERFORMANCE 

In  practice,  steady-state  performance  is  only  of  interest  when  the 
closed-loop  system  (3.8)  is  stable  over  'll.  The  following  result  expresses 
the  performance  in  terms  of  the  steady-state  closed-loop  second-moment 
matrix. 

Lemma  4.1:  Suppose  (3.8)  is  stable  for  all  (AA,  AB,  AC)  €  'll.  Then 
y(Ac,Be,Ce)=  sup  trgi/i^.  (4.1) 

where  i  lim,-*  ■£[x(f).«’’(t)]  6  71''  is  the  unique  solution  to 

0  =  (A+AA)(^iA  +  (^x4(A+AA)^+  ?.  (4.2) 

We  now  seek  upper  bounds  for  J(Ae,  Be,  Cc). 

Theorem  4.1:  Let  0:  71''  x  3'’^’''  x  -►  3''  be  such  that 

A/ldl+filA/4''£n(Cl,  Be,  Cc), 

(AA,  AB,  AC)  e  'U,  (£1.  C,)  £  2'')''x  Jl'’f'''xa'"’'"r,  (4.3) 


III.  ROBUST  STABILITY  AND  ROBUST  PERFOR,MANCE  PROBLEMS 

Let  'll  C  Jr*"’  X  •3'”“"  X  (3'’"’  denote  the  set  of  uncertain 
perturbations  (A  A,  AB,  AC)  of  the  nominal  plant  matrices  A,  B,  and  C. 

Robust  Stability  Problem.  For  fixed  tic  S  n,  determine  (A«,  Be,  CJ 
such  that  the  closed-loop  system  consisting  of  the  nth-order  controlled 
plant 

ii(t)  =  (A+AA)x(t)+(B+AB)u(t),  re(0, 00),  (3.1) 

measurements 

3-(0-(C+AC)x:(0.  (3.2) 

and  /teth-order  dynamic  compensator 

U‘)=AcXc(t)+Bcy(t),  (3.3) 

u(t)-=CcXc(t)  (3.4) 

is  asymptotically  stable  for  all  (AA,  'AB,  AC)  S  'll. 

Robust  Performance  Problem.  For.fixcd  Oe  ^  n,  determine  (Ac,  Be, 
Cc)  such  that,  for  the  closed-loop  system  consisting  of  the  /ith-order 
disturbed  plant 

.'f(r)a(A +AA)x(r)  +  (fl  +  AB)ti(0+ w,(0,  r  €  [0,  «),  (3.5) 


and,  for  given  (A,,  Be,  Cc),  suppose  there  exists  Q  6  ?]''  satisfying 

0=ACl+£lA’"+n(Cl,  fi„C,)+I^,  (4.4) 

and  suppose  the  p.air  (K''',  A  J-  AA)  is  stabilizable  for  all  (AA,  AB, 
AC)  € 'll  Then  A  *  AA  is  asymptoticall)  stable  for  all  (AA,  A5,  AC) 
e  •U. 

(AA,  AB,  AC)  e  ‘U,  (4.5) 

where  satisfies  (4.2),  and 

J(Ac,Bc,Cc)s:ir£lR.  (4.6) 

Proof:  For  ail  (AA,  AB,  AC)  S  Tl.  (4.4)  is  equivalent  to 

0=(A  +  AA)Cl+£l(A+AA)»'+'l-(«l.  Be,  C„  AA)+  i',  (4.7) 

where 

'fTQ,  Be,  Ce,  AA)  k  (1(0.,  Be,  Cc)~(AAQ.+O.AA^). 

Note  thaj  by  (4.3),  '{'(QL,  Be,  Ce,  AA)  Z  0  for  all  (AA,  AB,  AC)  £  “U. 
Since  (P'"^,  A  +  AA)  is  stabilizable  for  all  (AA,  AB,  AC)  €  Tl,  it 
follows  from  [16.  Theorem  3.6]  that  ((I^  +  'I'(Q,,  Be,  Ce,  AA))''^,  A  + 
AA)  is  stabilizable  for  all  (AA,  AB,  AC)  £  Tl.  Hence.  [16,  Lemma 
12.2]  implies  A  i-  AA  is  asymptotically  stable  for  all  (AA,  AB,  AC)  £ 
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“U.  Next,  subtracting  (4.2)  from<4.7)  yields 

or,  equivalently  (since  .4  +  A/4  is  asymptotically  stable), 

B„  C„  4,4)e<''*-^'''  d/aO, 

Jo 

which  implies  (4.5).  Finally,  (4.5)  and  (4.1)  yield  (4.6).  □ 

V.  Uncertainty  Structure 

To  obtain  explicit  expressions  for  (/!„  Be,  Q),  we  require  that  AB  = 
0,  (£iA,  AB,  AC)  €  “U.  Hence,  for  simplicity,  we  write  {AA,  AC)  € 
Tl.  The  dual  case  iifl  *  0  and  AC  =  0  is  treated  in  Section  X.  Thus,  11  is 
assumed  to  be  of  the  form 

11=  I  (A>1,  AC)  6  :AA='2  D.M.NtE,, 

C.  .  i-i 

AC^"^  FiM,NiE„  ,  (5.1) 

i«i  J 


VU.  THE  AUXILIARY  MINIMIZATION  PROBLEM 

To  optimize  robust  performance  while  guaranteeing  robust  stability,  we 
consider  the  following  problem. 

Auxiliary  Minimization  Problem:  Determine  (Q,  Ac,  Be,  Ce)  which 
minimizes 

m.  Ae.  Be,  Ce)  ^  tf  (7.1) 

subject  to 

CL  e  (7.2) 

0=AQ^+CLA^+'^  [DiM,pr+  dETftiS.CL]  +  P,  (7.3) 

<-i 

(K''^  A+AA)  is  stabilizable,  {AA,  AC)  €  11.  (7.4) 

Proposition  7.1:  If  (ft,  Ae,  Be,  Ce)  satisfies  (7.2)-(7.4),  then  A  + 
AA  is  asymptotically  stable  for  dl  {AA,  AC)  €  11  and 

J{Ae,  Be,  C,)£3(ft,  Ae,  Be.  Ce).  (7.5) 

Proof:  With  11  given  by  (6.1),  the  hypotheses  of  Theorem  4.1  are 
satisfied  so  that  robust  stability  is  guaranteed  with  performance  bound 
(4.6).  □ 


where,  for  i  =  1,  •  ■  • ,  p:  D,  €  Jl'"''!,  E,  €  711='",  and  F,  €  Jl'’"!  are 
fixed  matrices  denoting  the  strucmre  of  the  uncertainty;  Mi  €  and  M 
6  ?]'/ are  given  uncertainty  bounds;  and  Af;  €  71'i>‘i  and  N)  €  2'J’‘1are 
uncertain- matnces.  The  closed-loop  system  thus  has  strucmred  uncer¬ 
tainty  of  the  form 

AA  =  '^D,Mft,e„ 

(-1  ■ 


vm.  Necessary  Conditions  for  the  auxiliary  Minimization 

PROBLE.M 

Rigorous  derivation  of' the  necessary  conditions  for  the  Auxiliary 
Minimization  Problem  requires  additional  technical  assumptions.  Specifi¬ 
cally,  in  addition  to  (7.2),  we  restrict  (ft,  Ae,  Be,  Ce)  to  the  open  set 

S  =  {(ft,  Ae,  Be,  Cc) :  ft  S  fi  is  asymptotically  stable. 


where 

[b^f] 

The  special  case  Mi  =  fii  =  v]I,j  is  worth  noting. 

Proportion  5.1:  Let  p„  v/  a  0,  i  =  1,  •  •  •,  p.  Then  MiMf  ^  iijlr, 
and  N[Ni  S  vfl,.  if  and  only  if  a„a%{Mi)  <  m  and  CmufAl))  <  vi. 

Remark  5.1:  The  form  of  1l  given  by  (5.1)  is  directly  related  to  the 
structured  stability  radius  introduced  by  Hinrichsen  and  Pritchard  [17], 
(18).  Specifically,  letp  =  1,  iVifi  =  pi/,,,  Ti  =  Si,  andfVi  s  fl^  = 

VI.  THE  PETERSEN-HOLLOT  BOUND 

Given  11,  we  now  specify  the  bound  fl  satisfying  (4.3).  Note  that 
because  of  AB  =  0,  (1  is  independent  of  Ce.  Hence,  we  write  (l(ft,  Bf)  for 
m.  Be.  Ce). 

Proposition  6.1:  The  function 

IKft,  Be)  ^  2  PMi6f+et£fffi£,CL  (6.1) 

!•»  I  * 

satisfies  (4.3)  with  11  given  by  (5.1). 

Proof:  Fori  =  1,  ■■•,p, 

(i^[d,m,-cl^jnJ][5,m,~cl£Jn'\  ^ 

= DM,MJDJ^Q^JNIN,£,CL- {D,M,N,£,CL+  Cij£[NfM[D[) 


and  {Ae,  Be,  Ce)  is  controllable  and  observable}, 
where  (sec  (19)  for  the  definition  of  the  Kronecker  sum) 


-4  +  2 


Furthermore,  the  constraint  (7.4)  will  not  be  accounted  for  explicitly  since 
it  can  be  shown  that  the  compactness  of  11  implies  that  the  set  of  {Ae.  Be, 
Ce)  satisfying  (7.4)  is  open. 

Remark  8.1:  The  constraint  (ft,  eie.  Be,  Ce)  G  S  is  not  required  for 
either  robust  stability  or  robust  performance  since  Proposition  7.1  shows 
that  only  (7.2)-(7.4)  arc  needed.  Rather,  the  set  S  constitutes  sufficient 
conditions  under  which  (he  Lagrange  multiplier  technique  is  applicable  to 
the  Auxiliary  Minimization  Problem.  Specifically,  the  condition  ft  >  0 
replaces  (7.2)  by  an  open  set  constraint,  the  stability  of  d  serves  as  a 
nomiality  condition,  and  {Ae,  Be,  Ce)  minimal  is  a  nondegeneracy 
condition. 

For  arbitrary  Q,  P  E  71"""  define  the  following  notation: 

D  a  X  DiM,D^.  E^fe  S[£r,E.. 

I-I  /-I 

Pe  k  B^P+Rl,,  Q,  k  QC^+  Kij+j;  DiM.Ff, 

/•I 

A,  k  A-BR^P,,  Aq  A-QeV:Jc,  Vu  k  Pi-t-Jj  FiMj^f. 

•  •I 


SD.M,5j-tr  ftfi,'’lV.i.'ft-  {D,M,N,£,CL*-  ClPJNTMJDJ). 

Summing  over  /  yields  (4.3).  □ 

Renwrk  6.1:  TTie  bound  (6.1)  was  originally  proposed  by  Petersen  in 
(5)  for  unit-rank  perturbations  with  scalar  uncertain  parameters.  A  more 
general  treatment  appears  in  (7).  Note  that  we  absorb  the  epsilon  used  in 
[7]  into  Di  and  £). 


The  following  factorization  lemma  is  needed.  For  details,  see  (8J. 
Lemma  8. 1:  If  (5,  P  €  ?)"  and  rank  =  /;<,  then  there  exist  n,  X  n 
G,  r.  and  n,  x  n,  invertible  .V;'  such  that 

(8.1) 

rG''=f.,.  (8.2) 
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Furthermore,  G,  M,  and  T  arc  unique  except  for  a  change  of  basis  in  3*<. 
As  shown  in  (8i,  the  matrix  r  defined  by 

r  k  ^P{CPy=C’r  (8.3) 

is  an  oblique  projection  where  ( )'  denotes  group  generalized  Inverse  [8J. 
For  convenience,  define  the  complementary  projeoion  Tj.  §  —  t. 

Theorem  8.1:  If  (CL  Ac,  Be  Q)  S  S  solves  the  Auxiliary 
Mimrmzation  Problem  with  'll  given  by  (5. 1),  then  there  exist  Q,  P,  P 
€  such  that 


rg  r^F'-J  • 

(8.4) 

Ac=V{.A-BRz'Pi-Q,VuC+QE)G^. 

(8.5) 

Bc=tqcv:j. 

(8.6) 

Cc=-R:'PcG^, 

(8.7) 

and  such  that  Q,  P,  Q,,  satisfy 

O=/ie+0A>'+  V,^D^QEQ-Q,V-^Q\*r,.Q.v:^Qlr\.  (8.$} 

0=[AHQ+&El’'P*P[A+CQ-i-&El 

■i-Rt-PlR^'Pc+TlPZRz'P.re  (8.9) 

(8.10) 

(i={AQ*QE)^P±P(AQ+QE)+PlR:'P.-TlPlR{'P.T^.  (8.11) 

rank  rank  tank  (8.12) 

Furthermore,  the  auxiliary  cost  is  given  by 

3(«l.  Ac  Be  C,)=ir  V.Q¥&Ri+^PBR:'Pc-Rr.R:'P.<5.\-  (8.13) 

Conversely,  if  there  exist  Q,  P,<^,P^  53"  satisfying  (8.8)-(8.12).  then 
(Q.  Ac,  Be,  Ce)  given  by  {8.4)-(8.7)  satisfy  (7.2)  and  (7.3)  with  cost 
(8.13). 

Proof:  See  [13}.  (MJ.  □ 

Remark  8.2:  Theorem  8.1  presents  necessary  condiuons  for  the 
Auxiliary  Minimization  Problem  which  explicitly  characterize  extremal 
quadruples  (CL  Ac,  Be,  C,).  These  necessary  conditions  consist  of  a 
system  of  two  modified  Riccati  equations  and  two  modified  Lyapunov 
equations  coupled  by  both  the  optinial  projection  r  and  uncertainty  terms. 
Several  special  cases  can  immediately  be  discerned.  For  example,  in  the 
fullorder  case  /r,  =  r,  set  r  =  /.  so  that  Tj_  =  0.  Now  the  last  term  in 
each  of  (8.8)-(8.H)  can  be  deleted  and  C  and  F  in  (8.5)-(8.7)  can  be 
taken  to  be  the  identic.  Furthermore.  P  plays  no  role  so  that  (8.11)  is 
superfluous.  Note  that  in  this  case.  (8.8)  is  independent  of  P  and 
Setting  further  Dt,  Et,  and  Fi  to  zero,  it  can  be  seen  that  (8. 10)  and  (8. 1 1) 
drop  out.  while  (8.8)  and  (8.9)  reduce  to  the  standard  separated  Riccati 
equations  of  LCJG  theory.  If.  alternatively,  the  reduced-order  constraint  is 
retained,  but  the  uncertainty  terms  are  deleted,  then  the  results  of  [3]  ate 
recovered. 

Remark  8.3:  V/hen  solving  (8.8)-(8.l2)  numerically,  the  uncertainty 
terms  can  be  adjusted  to  examine  tradeoffs  between  performance  and 
robustness.  Specifically,  the  bourids  and  and  structure  matrices  Df, 
E„  and  F)  appearing  in  Q,,  D,  E,  and  can  be  vaned  systemaucaify  to 
determine  the  region  of  solvability  of  (8.8)-(8.12). 

DC.  SumciENT  Conditions  for  robust  stability  and 

PERFOR.MANCE 

Theorem  9.1:  Suppose  there  exist  Q,  P.^.P  E:  53*  satisfying  (3.8)- 
(8  12).  and  assume  that  (1?'^,  A  A^l)  is  stabilizable  for  all  (A/1.  AQ 
€  H  with  C,  given  by  (8.5)-{8.7)  and  'll  given  by  (5. 1).  Then  /I 
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*  AA  is  asymptotically  stable  for  all  (A/l.  AC)  6  Tl  and  the  closed.lbcp 
performance  is  bound^  by  (8.13). 

'Proof:  Theorem  8. 1  implies  that  Q,  given  by  (8.4)  satisfies  (7.2)  and 
(7.3).  With  the  stabilizability  assumption,  the  result  follows  from 
Proposition  7.1.  □ 

X.  THE  DU.AL  Case 

In  place  of(5  1),  assume  now  that  AC  =  0,(A/1,A£.AC)  €  'll,  and 
define 

Tl-  I  (OlA,  AS)  6  a'-xQ*—  :  A4=|j  D.MiNtE„ 

L  /-I  ■ 

AB='2  D,MiN,G,.  — .p|  .  (lO.l) 

1-1  J 

where.forr  =  1,  2'/’'",a.idC;€  2'i*"are 

fixed  matrices  denoting  the  structure  of  the  uncertainor;  and  Mi, 

and  Af/  are  as  before.  For  arbitrary  Q,  P  E  3'**  define  the  following 
notauon: 

Pc  k  B^P*R\^+'^  Gjft,Ei.  (2.  k  QC’-+f'n. 

.  1*1 

A^kA-BR^'Pe  Ag  kA~^y'‘C.  Ri,k  Ri^'^Gffi.C,. 

>-i 

The  main  result  guaranteeing  robust  stabiliQr  and  performance  for  the 
dual  problem  can  now  be  stated.  For  details.  see.(I3).  [14). 

Theorem  10. 1:  Suppose  there  axis  P,  Q,  P,^E  13"  satisfying  (8.12) 
and 

O^A^Pi-PA+Ri+E+PDP-PlRl'Pc+TlP^Rl'PcT,,.  (10.2) 
0=‘lA+D{P+P)]Q-i-QlA+D[P+P)]^ 

-  (80-3) 

0={Ag+DP)^P+P{Ag-i-DP)A-PDP+P^Rl,'P.-T{P^R^P,T.. 

(10.4) 

0={Af+DP)C+ Q1A,*DP)^^  Qc  (10 J) 

and  assume  that  (R"*,  A  ~  A/f)  is  detectable  for  all  (AA,  AS)  6  'll 
with  Ac,  Be,  Ce  given  by 

Ac=nA-^y:'C-BRl'P,^DP)G'.  (10.6) 

Bc=rC.yi'-  (iO.7) 

Cc=-r:Jp.o^.  (10.8) 

and  Tl  given  by  (10. 1).  Then,  with  (I0.6)-(I0.S).  A  -i-  AA  is 
asymptotically  stable  for  all  (A/1,  AB)  €  'll  and  the  performance  of  the 
closed-loop  system  satisfies 

J{A„  Be  CJStr  [{P*^P)V,*Q.V:'CQP-PQ.VV Pf.).  (10.9) 

Remark  lO.l:  Even  in  the  case  AB  =  0.  AC  =  0.  the  performance 
bounds  (8.13)  and  (10.9)  are  generally  different. 

Remark  10.2:  The  case  in  which  AB  and  AC  are.simultaneously 
nonzero  also  appears  to  be  tractable  and  leads  to  additional  terms  in  the 
design  equations.  Thebound  considered  in  [1 1]  also  permits  this  case. 
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Robust  Stability  and  Performance  via  Fixed-Order 
Dynamic  Compensation  with  Guaranteed  Cost  Bounds* 

Dennis  S.  Bernsteint  and  Wassim  M.  HaddadJ 

Abstract.  A  feedback  control-design  problem  involving  structured  plant  parame¬ 
ter  uncertainties  is  considered.  Two  robust  control-design  issues  are  addressed.  The 
Robust  Stability  Problem  involves  deterministie  bounded  structured  parameter 
variations,  while  the  Robust  Performance  Problem  includes,  in  addition,  a  qua¬ 
dratic  performance  criterion  averaged  over  stochastic  disturbances  and  maximized 
over  the  admissible  parameter  variations.  The  optimal  projection  approach  to 
fixed-order  dynamic  compensation  is  merged  with  the  guaranteed  cost  control 
approach  to  robust  stability  and  performance  to  obtain  a  theory  of  full-  and 
reduced-order  robust  control  design.  The  principle  result  is  a  sufficient  condition 
for  characterizing  dynamic  controllers  of  fixed  dimension  which  are  guaranteed  to 
provide  both  robust  stability  and  performance.  The  sufficient  conditions  involve 
a  system  of  modified  Riceati  and  Lyapunov  equations  coupled  by  an  oblique 
projection  and  the  uncertainty  bounds.  The  full-order  result  involves  a  system  of 
two  modified  Riccati  equations  and  two  modified  Lyapunov  equations  coupled  by 
the  uncertainty  bounds.  The  coupling  illustrates  the  breakdown  of  the  separation 
principle  for  LQG  control  with  structured  plant  parameter  variations. 

Key  words.  Robust  stability.  Robust  performance.  LOG  control.  Dynamic  com¬ 
pensation.  structured  uncertainty. 

1.  Introduction 

The  direct  method  of  Lyapunov  has  proven  to  be  an  effective  approach  to  robust 
analysis  and  design  of  feedback  control  laws.  References  [Bl],  [B2],  [BCL],  [BG2], 
[CL],  [CP],  [ER],  [GB],  [H],  [KB],  [KBH],  [L],  [PH],  [TB],  and  [VW]  comprise 
a  representative  collection  of  the  literature  in  this  area.  In  performing  robust 
synthesis  there  are  two  principal  issues,  mirnely,  stability  robustness  and  perfor¬ 
mance  robustness.  Stability  robustness  addresses  the  problem  of  guaranteeing 
stability  of  the  closed-loop  system  for  plant  perturbations  within  a  specified  class 
of  uncertainties.  In  addition  to  guaranteeing  robust  stability,  it  is  often  desirable  to 
minimize  the  worst-case  performance  degradation  within  a  given  robust  stability 
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range.  Although  both  robust  stability  and  performance  are  of  interest  in  practice, 
most  of  the  literature  involving  quadratic  Lyapunov  functions  deals  only  with  the 
problem  of  robust  stability.  A  notable  exception  is  the  early  work  of  Chang  and 
Peng  [CP]  which  also  provides  bounds  on  worst-case  quadratic  performance  within 
full-state  feedback  control  design. 

The  contribution  of  this  paper  is  a  methodology  for  designing  controllers  which 
provide  both  robust  stability  and  robust  performance  over  a  prescribed  range  of 
structured  plant  parameter  variations.  The  feedback  law  is  in  the  form  of  a  fixed- 
order  (i.e.,  full-  or  reduced-order)  strictly  proper  dynamic  compensator.  The  overall 
approach  is  based  upon  the  merging  of  two  distinct  control-design  techniques, 
namely,  the  guaranteed  cost  control  approach  to  robust  performance  [CP]  and  the 
optimal  projection  approach  to  fixed-order  dynamic  compensation  [BH3],  [HB]. 
The  principal  motivation  for  our  approach  is  to  permit  greater  flexibility  in  the 
design  of  robust  feedback  laws  by  providing  an  alternative  to  full-state  feedback 
and  full-order  dynamic  compensation. 

The  guaranteed  cost  control  approach  [CP]  adopted  in  this  paper  utilizes  a 
performance  bound  to  provide  robust  performance  in  addition  to  robust  stability. 
Here,  robust  performance  refers  to  a  guaranteed  bound  on  the  worst-case  value  of 
the  expectation  of  a  quadratic  cost  criterion  over  a  prescribed  uncertainty  set.  This 
quadratic  criterion  is  predsely  the  sttiidard  cost  functional  of  linear-quadratic- 
Gaussian  (LQG)  control  theory.  By  bounding  the  worst-case  value  of  this  criterion 
over  a  specified  range  of  plant  uncertainties,  we  effectively  bound  the  variances  of 
specified  states  and  control  signals. 

To  bound  the  worst-case  closed-loop  performance,  we  require  a  bound  on  the 
effect  of  plant  uncertainties  on  the  steady-state  closed-loop  covariance  matrix.  The 
form  of  the  guaranteed  cost  control  bound  utilized  herein  was  originally  motivated 
by  the  effect  of  multiplicative  white  noise  on  the  state  covariance  [B2],  [BG2].  Since 
this  bound  is  differentiable  with  respect  to  the  covariance  matrix  and  compensator 
gains,  it  permits  optimal  design  via  first-order  necessary  conditions.  This  approach 
is  not  possible  using  the  nondifferentiable  bound  ordinally  proposed  in  [CP].  An 
alternative  differentiable  bound  proposed  in  [PH]  for  full-state  feedback  has  been 
extended  to  fixed-order  dynamic  compensation  in  [BHI]. 

In  this  paper  the  guaranteed  cost  technique  is  used  to  bound  the  closed-loop 
performance  and  characterize  robustly  stabilizing  controllers.  This  performance 
bound  is  then  interpreted  as  an  auxiliary  cost  which  is  to  be  minimized  by  the  choice 
of  compensator  gains.  The  actual  performance  for  a  given  realization  of  the  parame¬ 
ter  uncertainty  is  thus  guaranteed  to  lie  below  this  bound.  Assuming  stabilizability 
(disturbability),  the  robust  performance  bound  automatically  implies  robust  sta¬ 
bility.  The  auxiliary  cost  and  the  Lyapunov  equation  constraint  together  form  the 
Auxiliary  Minimization  Problem.  Since  the  Auxiliary  Minimization  Problem  is 
a  nonconvex  mathematical  programming  problem  with  differentiable  data,  it  is 
amenable  to  first-order  necessary  conditions. 

One  feature  of  this  approach  is  that  since  the  necessary  conditions  are  obtained 
for  the  Auxiliary  Minimization  Problem  rather  than  the  original  problem,  extremals 
are  guaranteed  to  provide  both  robust  stability  and  performance.  Note  that  this  is 
true  for  every  extremal  of  the  Auxiliary  Minimization  Problem  whether  it  corre- 
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spends  to  a  local  minimum,  local  maximum,  or  otherwise.  Of  course,  the  global 
minimum  is  most  likely  to  provide  the  best  worst-case  performance  over  the  robust 
stability  range.  In  any  case,  necessary  conditions  for  the  Auxiliary  Minimization 
Problem  effectively  serve  as  sufficient  conditions  for  robust  stability  with  a  guaran¬ 
teed  performance  bound. 

This  paper  presents  a  rigorous  development  of  sufficient  conditions  for  robust 
stability  and  perform.^nce  via  fixed-order  dynamic  compensation.  These  sufficient 
conditions  are  in  the  form  of  a  coupled  system  of  algebraic  matrix  equations 
consisting  of  two  modified  Riccati  equations  and  two  modified  Lyapunov  equa¬ 
tions.  The  coupling  is  due  to  the  optimal  projection,  which  characterizes  reduced- 
order  controllers,  and  the  uncertainty  bounds,  which  account  for  the  effect  of 
parameter  uncertainties  on  the  performance  functional.  When  the  compensator 
order  is  constrained  to  be  equal  to  the  dimension  of  the  plant  and  the  uncertainty 
bounds  are  absent,  the  equations  specialize  to  the  usual  pair  of  separated  Riccati 
equations  of  steady-state  LQG  theory. 

We  emphasize  that  our  approach  is  constructive  in  nature  rather  than  existential. 
Our  sufficient  conditions  provide  explicit  formulae  for  robust,  fixed-order  feedback 
gains  when  the  Auxiliary  Minimization  Problem  has  a  solution,  and  in  this  case  our 
constructive  conditions  are  complementary  to  existential  results  on  robust  sta- 
bilizability.  The  existence  of  a  solution  to  the  Auxiliary  Minimization  Problem  and 
associated  design  equations  depends  upon  stabilizability  via  fixed-order  controllers 
and  on  the  sharpness  of  the  quadratic  Lyapunov  bounds.  The  stabilizability  prob¬ 
lem  has  been  studied  using  independent  methods  (see.  e.g.,  [BHK]),  while  the 
conservatism  of  the  bounds  is  considered  in  [BH2].  Here  we  state  a  local  exis¬ 
tence  result  for  solvability  of  the  design  equations  which  assumes  only  nominal 
stabilizability. 

The  contents  and  scope  of  this  paper  are  as  follows.  In  Section  2  we  state  the 
robust  stability  and  performance  problems  for  fixed-order  dynamic  compensation 
with  plant  parameter  uncertainty.  In  Section  3  a  modified  Lyapunov  equation 
is  introduced  whose  solution,  when  it  exists,  is  guaranteed  to  bound  the  steady- 
state  closed-loop  covariance  over  the  specified  range  of  plant  uncertainty.  A  per¬ 
formance  bound  is  then  given  in  terms  of  the  covariance  bound.  In  Section  4  we 
view  the  performance  bound  as  an  auxiliary  cost  and  consider  the  problem  of 
minimizing  the  auxiliary  cost  subject  to  the  modified  Lyapunov  equation  and  a 
definiteness  condition  as  side  constraints.  These  side  constraints  have  the  property 
that  all  admissible  elements  provide  robust  stability  and  performance  (Proposition 
4.1).  In  Section  5  the  uncertainty  set  and  bound  for  constructing  the  modified 
Lyapunov  equation  are  given  concrete  forms.  Specifically,  the  uncertainty  set  has 
the  form  of  an  ellipsoidal  region  in  parameter  space  while  the  modified  Lyapunov 
equation  includes  additional  linear  terms  to  bound  the  uncertainty.  A  sufficient  con¬ 
dition  involving  Kronecker  sums  and  products  implies  the  existence  of  a  unique, 
nonnegative-definite  solution  to  the  modified  Lyapunov  equation.  Section  6  pre- 
.sents  the  first-order  necessary  conditions  (Theorem  6.1)  for  the  Auxiliary  Mini¬ 
mization  Problem  under  minor  additional  technical  conditions  to  ensure  the  appli¬ 
cability  of  the  Lagrange  multiplier  technique.  As  discussed  above,  these  necessary 
conditions  arc  in  the  form  of  extended  optimal  projection  equations.  A  partial 
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converse  of  the  necessary  conditions  shows  that  solutions  of  these  algebraic  equa¬ 
tions  provide,  by  construction,  a  solution  of  the  original  modified  Lyapunov  equation. 
This  result  is  combined  in  Section  7  (Theorem  7.1)  with  a  stabilizability  assumption 
to  guarantee  robust  stability  with  a  robust  performance  bound.  In  addition,  we  state 
an  existence  result  for  local  solvability  of  the  design  equations  by  applying  a  result 
from  [Rl]  and  [R2]  (Theorem  7.2).  To  draw  connections  with  standard  LQG 
theory,  in  Section  8  we  specialize  Theorem  7.1  to  the  full-order  case.  In  contrast  to 
the  pair  of  separated  Riccati  equations  of  standard  LQG  theory,  the  full-order  result 
in  the  presence  of  plant  parameter  variations  is  given  by  a  coupled  system  of  four 
modified  Riccati/Lyapunov  equations.  In  Section  9  the  theory  is  illustrated  by 
means  of  an  example  due  to  Doyle  [D].  This  problem  was  also  considered  in  [BG 1] 
before  the  robustness  theory  developed  herein  was  available.  Hence  this  paper  can 
be  viewed  as  the  rigorous  mathematical  foundation  which  legitimizes  the  heretofore 
ad  hoc  robustness  approach  of  [BGl]. 

Notation.  Note:  All  matrices  have  real  entries 
E 

/„( 

^U.J) 

S^  N',  fP' 

Zj  ^  Z2,  Zi  <  z, 

Rj,  Rl 

R.2 

R 

Wl(-),  W2(-) 

1^12 

>v(-),  y 


2.  Robust  Stability  and  Robust  Performance  Problems 

In  this  .section  we  state  the  Robust  Stability  Problem  and  Robust  Performance 
Problem.  Bot.f»  problems  involve  a  set  c:  K'”'"  x  x  x  R'*""  of  uncer¬ 
tain  perturbations  (A/l,  AB,  AC,  AD)  of  the  nominal  system  matrices  (.d,  B,  C,  D). 
The  goal  of  thp  Robust  Stability  Problem  is  to  determine  a  fixed-order,  strictly 
proper  dynamic  compensator  (/^e,  B<.,  C,.)  which  stabilizes  the  plant  for  all  variations 
in  '//  In  this  section  and  the  following  section  no  explicit  assumptions  are  required 
for  the  set  -7/.  In  Section  5  the  structure  of  variations  in  will  be  specified. 


expected 'value 

r  X  r  identity  matrix,  transpose,  r  x  s  zero  matrix,  0,^, 
(1,  y)-element  of  matrix  Z 
Kronecker  sum,  Kronecker  product  [B3] 
r  X  r  symmetric,  nonnegative-definite,  positive-definite 
matrices 

Zj  -  Zi  s  N',  Z2  -  Z,  e  (P^  Z,,  Z,  s  S' 

A  +  ictl2)I„,A,  +  ial2)I„^ 

state,  control  weighting  matricesj  Rj  e  W",  R2  e  P" 

n  X  m  cross-weighting, matrix:  R,  -  Ri2R2'^l2  ^  0 

r  Rl  ^I2^e  1 

LCJRI2  CJR.Q] 

n,  /-dimensional"  white  noise 

intensity  of  ivj('),  Wzl');  s  W",  K  s  P‘ 

n  X  I  cross  intensity  of  »v,(-),  vv,(-) 

r *vj(-) If  V, 

Lb,W2(-)J’Lb,K,^ 
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Robust  Stabiiity  Problem.  For  fixed  <  n  determine  (A„  such  that  the 
closed-loop  system  consisting  of  the  nth-order  controlled  plant, 

.'c(t)  =  (/l-P  fs[0.x),  (2.1) 

measurements 

y(t)  =  (C  +  AC)x(f)  +  {D  +  AD)uit),  (2.2) 

and  /ijth-order  dynamic  compensator 

.VeCO  =  /4e.x,.(t)  +  (2.3) 

«(£)  =  Ce.v.(t),  (2.4) 

is  asymptotically  stable  for  all  (A/4,  AB,  AC,  AD)  e  ^/. 


The  Robust  Performance  Problem  involves,  in  addition,  white  plant  disturbances 
and  measurement  noise.  The  goal  of  this  problem  is  to  determine  a  fixed-order, 
strictly  proper  compensator  {A^,  B^,  C^)  which  minimizes  the  worst-case  value  over 
the  uncertainty  set  of  a  steady-state  average  quadratic  performance  criterion. 

Robust  Performance  Problem.  For  fixed  n^  ^  n,  determine  (.45,  B^,  C^)  such  that, 
for  the  closed-loop  system  consisting  of  the  nth-order  controlled  and  disturbed  plant 

.^(t)  =  (.4 A/4)x(£)  +  (B  +  AB)u(t)  4- w,(f),  t6[0,  x),  (2.5) 

noisy  measurements 

y(f)  =  (C  -(•  AC).x(t)  -1-  (D  +  AB)«(r)  +  w,(£),  (2.6) 

and  n^th-order  dynamic  compensator  (2.3),  (2.4),  the  performance  criterion 
J(A,.  B„  C.)  ^ 

sup  lim  sup  E[.x'''(f)R,.x(£)  +  2.x "''(£) R,,H(t)  +  «'’'(£)/?, n(£)]  (2.7) 

i/  i-x 

is  minimized. 

Remark  2.1.  The  cost  functional  (2.7)  is  identical  to  the  standard  LQG  criterion 
with  the  exception  of  the  supremum  for  evaluating  worst-case  quadratic  perfor¬ 
mance  over  •'//.  Note  that  (2.7)  can  also  be  written  in  terms  of  an  averaged  integral,  i.e., 

J(/4,.  B,.  Q)  = 

1  f  f'  - 

sup  lim  sup -E<  [.x'(s)K,.x(s)  +  2.x^(s)R,,i((.s)  +  m’'^(s)B,h(.s)]  ds 

1/  i-x  f  (Jo 

For  practical  application,  the  cost  (2.7)  provides  the  means  for  minimizing  the 
variances  of  selected  state  variables  and  control  signals.  This  can  be  achieved  by 
appropriate  selection  of  the  matrices  R,  and  R,  which  serve  as  design  weights.  For 
robust  performance  the  goal  is  to  minimize  the  worst-case  variances  of  selected 
variables  over  the  plant  uncertainty. 
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For  each  uncertain  variation  (A/1.  AS.  AC,  AD)  e  ■'//,  the  undisturbed  closed-loop 
system  (2.1)-(2.4)  can  be  written  as 

.^(0  =  {A  +  AA)m,  1 6  [0.  00),  (2.8) 

where 


BQ 

Ag  -f-  B,.DCi 


9 


AA^ 


AA  ASCe  ■ 
S^AC  B,:ADC,_' 


Similarly,  the  disturbed  closed-loop  system  (2.3)-(2.6)  can  be  written  as 

.^(f)  =  (/4 -t-  A/4).v(r)  +  w{t),  t  6  [0.  x),  (2.9) 

where  the  closed-loop  disturbace  w(t)  has  intensity  Ve  1^". 


3.  Sufficient  Conditions  for  Robust  Stability  and  Performance 

In  practice,  steady-state  performance  is  only  of  interest  when  the  undisturbed 
closed-loop  system  (2.8)  is  robustly  stable  over  The  following  result,  which 
e,\presses  the  performance  in  terms  of  the  steady-state.closed-loop  second-moment 
matri.x,  is  immediate. 

Lemma  3.1.  Let  (A^,  B^,  Q)  be  given  and  assume  the  system  (2.8)  is  stable  for  all 
(A/4,  AB,  AC,  AD)  6  4'.  Then 

J(/4e,Bc.  Q=  sup  tr  Q^R,  (3.1) 

where  ^  (E[.x(c).x^(t)]  e  PiJ"  is  the  unique  solution  to 

0  =  (A  +  A/4)Ojj  +  Q,^(A  +  A,4)^  -1-  K  (3.2) 

Remark  3.1.  When  •'//  is  compact,  “sup”  in  (3.1)  can  be  replaced  by  “ma.x." 

The  key  step  in  guaranteeing-robust  stability  and  performance  is  to  replace  the 
uncertain  terms  in  the  covariance  Lyapunov  equation  (3.2)  by  a  bounding  function 
Q.  Note  that  since  AA  is  independent  of  A,.,  the  bounding  function  need  only  depend 
upon  Be  and  C^. 

Theorem  3,1.  Let  Q;  1^"  x  jR"*’*'  x  R"”*'’'  -♦  S"  be  such  that 

AAJ  +  AAA^  <  £2(i.  CJ, 

(A/4,  AB,  AC,  AD)  e  %  (J,  B^,  CJ  6  x  R"' '' '  x  R" (3.3) 

and,  for  given  (A^,  B^,  C^),  assume  there  e.xists  satisfying 

0  =  Ad  +  dA'^  +  n(i.  Be,  Ce)  +  V.  (3.4) 

Then 

(A  4-  AA,  [y+Q(d,  Be.  Ce)  —  (AAd  +  4lA.4^)]  ''^)  is  stabilizahle, 

(A/4.  AB,  AC,  AD)  e  'U,  (3.5) 
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if  and  only  if 

A  +  A/T  is  asymptotically  stable,  (A/1,  AB.  AC  AD)  e  'U.  (3.6) 

In  this  case, 

Qsa  ^  -5,  (A/1,  AB,  AC.  AD)  e  '//,  (3.7) 

where  Qsa  is  given  by  (3.2),  and 

J{A^,B„Q)<tt.'2R.  (3.8) 


Proof.  First  note  for  clarity  that  in  (3.3)  A  denotes  an  arbitrary  element  of  (^"  since 
(3.3)  holds  for  all  Ji  e  while  in  (3.4)  ^  denotes  a  specific  solution  to  (3.4).  Now 
for  (A/1.  AS.  AC,  AD)  e  %  (3.4)  is  equivalent  to 


0  =  (.?  +  AA)^  +  ^(A  +  A/1^)  +  n(i,  B„  C)  -  (AA^  +  iA/1^)  +  K  (3.9) 


Hence,  by  assumption,  (3.9)  has  a  solution  .2  6  fd"  for  all  (A/1,  AB,  AC,  AD)  e  21  and. 
by  (3.3),  niji,  B,_,  CJ  -  (A/l J  +  JA^)  is  nonnegative  defiiiite.  Now  if  thestabiliz- 
ability  condition  (3.5)  holds  for  all  (A/1,  AB,  AC,  AD)  '6  %  it  follows  from  Lemma 
12.2  of  [W]  that  A  +  AA  is  asymptotically  stable  for  all  (A/1,  AB.  AC,  AD)  6  21. 
Conversely,  if  A  A-  A,4  is  asymptotically  stable  for  all  (A/1,  AB,  AC.  AD)  6  2/.  then 
(3.5)  holds.  Next,  subtracting  (3.2)  from  (3.9)  yields 


0  =  (/T  +  AA)(J  -  2.5.1)  +  (£-  Qm){A  +  A4)^  +  B„  Q)  -  (A^i  +  JAA^), 
or,  equivalently,  sirice  Z  +  A/T  is  asymptotically  stable  for  all  (A-4,  AB,  AC,  AD)  g  2/, 


i 


-5.-  r 


e<^*‘^^’'[n(i.  B„  Cc)  -  (A/li  +  5A/lT)]e<^+^^''‘  dt  ^  0. 


which  implies  (3.7).  The  performance  bound  (3.8)  is  now  an  immediate  consequence 
of  (3.7).  ■ 


Remark  3.2.  In  applying  Theorem  3.1  it  may  be  convenient  to  replace  condition 
(3.5)  with  a  stronger  condition  which  is  easier  to  verify  in  practice.  Clearly,  (3.5)  is 
satisfied  if  K  +  Q(^,  B^,  C,.)  —  {AA.2  +  2AA^)  is  positive  definite  for  all  (A/1.  AB. 
AC,  AD)  g  '-'//.This  will  be  the  case,  for  e.xample.  if  either  Fis  positive  definite  or  strict 
inequality  holds  in  (3.3).  Also,  it.  follows  from  Theorem  3.6  of  [W]  that  (3.5)  is 
implied  by  the  stronger  condition 

(.4  +  A/T,  F"-)  is  stabiiizabie.  (A/l,  AB,  AC,  AD)  g  2/.  (3.10) 


Remark  3.3.  The  covariance  bound  (3.7)  can  also  be  used  to  analyze  the  effect  of 
disturbances  on  specified  state  variables.  For  example,  if  £,  gR''''",  then  (3.7) 
implies 


[£.  0, 


(3.11) 


so  that  the  right-hand  side  of  (3.1 1)  serves  as  a  bound  on  selected  state  variances. 
For  control-design  purposes  vve  effectively  set  B,  =  E\Ei.  Similar  remark.s  app'.y 
lo  obtaining  bounds  on  the  variances  of  control  signals. 
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4,  The  Auxiliary  Minimization  Problem 

The  key  step  in  our  development  involves  consideration  of  the  performance  bound 
(3.8)  in  place  of  the  actual  worst-case  performance  C^).  This  leads  to  the 

following  problem. 

Auxiliary  Minimization  Problem.  Determine  {2,  A^,  Q)  which  minimizes 

Jfi2,Ac,B,,Cc)^ir2R  (4.1) 

subject  to  (3.4)  and 

2  e  (4.2) 

The  relationship  between  the  Auxiliary  Minimization  Problem  and  the  Robust 
Stability  and  Performance  Problems  is  straightforward  as  shown  by  the  following 
observation. 

Proposition  4.1.  If  (2,  A^,  Q)  satisfies  (3.4)  and  (4.2)  and  the  stabilizabdiiy 
condition  (3.5)  holds,  then  A  H'  A  A  is  asymptotically  stable  for  all  (A4,  AB,  AC,  AD)  s 
21,  and 

J(A„B„C,)</{2,A„B„C,).  (4;3) 

Proof.  Since  (3.4)  has  a  solution  2  e  and  the  stabilizability  condition  (3.5)  holds, 
the  hypotheses  of  Theorem  3.1  are  satisfied  so  that  robust  stability  with  robust 
performance  bound  (3.8)  is  guaranteed;  (4.3)  is  merely  a  restatement  of  (3.8).  ■ 

Several  comments  are  in  order.  Since  the  auxiliary  cost  (4.1)  is  an  upper  bound 
for  the  actual  cost  (2.7),  it  is  clearly  desirable  to  minimize  (4.1)  over  2  and  the 
controller  gains.  Note,  however,  that  the  Auxiliary  Minimization  Problem  is  a 
nonconvex  mathematical  programming  problem  on  a  noncompact  set.  Hence  exis¬ 
tence  of  solutions  and  sufficient  conditions  for  global  optimality  cannot  be  obtained 
without  imposing  additional  restrictive  assumptions.  To  develop  nonrestrictive 
results,  we  proceed  in  Section  6  by  deriving  necessary  conditions  for  optimality 
which  require  no  further  assumptions  except  that  Q  be  differentiable  and  that  the 
minimization  be  performed  over  an  open  set.  In  the  next  section  we  construct  a 
bound  Q  which  possesses  the  required  smoothness. 


5.  Uncertainty  Structure  and  the  Guaranteed  Cost  Bound 

Having  established  the  theoretical  basis  for  our  approach,  we  now  assign  explicit 
structure  to  the  set  'W  and  bounding  function  fi.  Specifically,  the  uncertainty  set  2/ 
is  assutiicd  to  be  of  the  form 

2/  =  J(A/1.  AB.  AC  AD):  AA  =  f  OiA,..  AB  =  f  (X.-B,-.  AC  =  f  tXjC.. 

I.  I*!  |B1  i^I 

AD  =  X  Z  ^  (5.1) 

i»l  i-l  ) 
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where  for  i  =  1,  ....  p:  /l.-sIR"’'",  B.-eK”’*'",  CiSR'**"  and  B.eR'’''"  are  fixed 
matrices  denoting  the  structure  of  the  parametric  uncertainty;  a,-  is  a  given  positive 
number;  and  is  an  uncertain  real  parameter.  Note  that  the  uncertain  parameters 
Ci  are  assumed  to  lie  in  a  specified  ellipsoidal  region  in  The  closed-loop  system 
(2.8)  thus  has  structured  uncertainty  of  the  form 


where 


^  P  ^ 

A/1  =  X  o’j/li. 

ia| 


1,4 


B,C,  ■ 
BcAcJ’ 


i  =  l,...,p. 


(5.2) 


The  uncertainty  set  ^  is  general  in  the  sense  that  no  explicit  assumptions  such  as 
the  matching  conditions  used  in  [BCL]  will  be  made  with  regard  to  the  structure 
of  Ai,  B;,  Q,  and  Di.  We  do,  however,  require  (as  is  evident  from  (5.1))  that  the 
uncertain  parameters  ff,  appear  linearly  in  the  off-nominal  perturbations  which  is 
more  confining  than  matching  assumptions.  Note  that  the  symmetry  of  the  uncer¬ 
tainty  set  entails  no  loss  of  generality  by  requiring  only  a  redefinition  of  the  nominal 
plant  matrices. 

In  order  to  obtain  explicit  gain  expressions  for  (A^,  Q)  in  Section  6,  we  shall 
require  one  additional  technical  assumption.  Specifically,  we  assume  that,  for  each 
i  g  {1, ...,  p},  at  most  one  of  the  matrices  B,,  Q,  and  D,  is  nonz_ero.  This  condition 
thus  implies  that  a  given  uncertain  parameter  o-,  may  appear  explicitly  in  both  A/1 
and  AB,  or  both  AA  and  AC,  or  both  AA  and  AD,  or  only  AA,  but  not  (say)  in  both 
A3  and  AD.  Thus  we  can  account  partially  (but  not  totally)  for  correlated  parameter 
uncertainties  in  different  plant  matrices.  If  a  given  uncertain  parameter  does  arise 
in  both  (say)  AB  and  AD,  then  it  must  be  represented  by  tv/o  distinct  uncertain 
parameters.  If  this  assumption  is  not  imposed,  then  optimality  conditions  can  still 
be  derived,  but  at  the  expense  of  closed-form  gain  expressions. 

For  the  structure  of  'li  as  specified  by  (5.1),  the  bound  Q  satisfying  (3.3)  can  now 
be  given  a  concrete  form. 


Proposition  5.1.  Let  a  be  an  arbitrary  positive  scalar.  Then  the  function 

n(j>,  Be,  Ce)  =  -1-  a”‘  Y.  ttfAi^A^  (5.3) 

i=l 

.•iati.fie:;  (3.3)  with  ■■'U  yiven  by  (5.1). 


Proof.  Note  that 


0  <  1  ~  (a,/a‘'^)i'i]  J[{a‘'V,/ai)/„-  -  (a./a'--)/!,]^ 


1  =  1 


=  a  Z  +  a"‘  £  xfAi^Aj  -  Y 


i=l 


1  =  1 


which,  since  £?=,  fff/af  ^  1,  implies  (3.3). 


Remark  5.1.  Note  that  the  bound  Q  given  by  (5.3)  consists  of  two  distinct  terms. 
The  first  term  ai  c.5n  be  thought  of  as  arising  from  an  exponential  time  weighting 
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of  the  cost,  or,  equivalently,  from  a  uniform  right  shift  of  the  open-loop  dynamics 
[AM].  The  second  term  a"‘ ^f=,  arises  naturally  from  a  multiplicative 

white-noise  model  [BGl],  [BG2],  [B].  Such  interpretations  have  no  bearing  on  the 
results  obtained  here  since  only  the  bound  Cl  defined  by  (5.3)  is  required.  Note  that 
the  bound  (5.3)  is  valid  for  all  positive  a.  A  similar  bound  was  also  considered  in 
[KB]. 


With  n  defined  by  (5.3),  the  modified  Lyapunov  equation  (3.4)  becomes 


or,  equivalently. 


where 


0  =  A:^  +  -i-  aj  a“'  ^  ayAilAj  +  V 


0  =  A,1  +  2Aj  +  X  -/iAi^SAT  +  K 

i=l 


(5.4) 

(5.5) 

(5.6) 


and  V;  ^  a,?/a.  Note  that  (5.5)  is  equivalent  to 

0  =  .!s/  vecJ  +  vec  K  (5.7) 

where  “vec”  is  the  column-stacking  operation  defined  in  [B3]  and  .r/  is  defined  by 

^  A^@Aj+  Y,  V( Ai  @  Ai- 


i«l 


Next,  using  the  bound  Q  given  by  (5.3)  and  -'//  given  by  (5.1)  we  present  a  result 
which  guarantees  the  existence  of  a  nonnegative-definite  solution  to  (3.4)  or.  equiv¬ 
alently.  (5.5)  for  a  given  controller  (/l^,  Q).  For  the  converse  we  vie<v  V as  an 

arbitrary  element  of 


Proposition  5.2.  Let  (Ae,  Q)  he  given  and  let  a  >  0.  If.^  is  asymptotically  stable, 
then  there  exists  a  unique  hy.  hd  satisfying  (5.5)  andjurthermore.  4  >  0.  Conversely, 
if  for  all  VeN"  there  exists  ,i>0  satisfying  (5.5),  then  ,«/  is  asymptotically  stable. 

Proof.  Since  (5.5)  is  equivalent  to 

i  =  —  vec"*[.r/"‘  vec  F],  (5.8) 

existence  and  uniqueness  hold.  To  prove  that  i  is  nonnegative  definite,  we  rewrite 
(5.8)  as 

i  =  J  vec”'[«r'^'  vec  F]  dt  (5.9) 

and  show  that  the  integrand  is  npnnegative  definite  for  all  t  e  [0,  x).  (Note  that  the 
following  argument  does  not  require  that  -r/  be  stable).  Using  the  Lie  exponential 
product  formula,  the  exponential  in  (5.9)  can  be  written  as 

=  lim  jexp  j^i(/r,©  j  JQ  expj^ivi(.4;@  A,)t 


(5.10) 
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For  convenience,  let  S  and  /V  be  r  x  r  matrices  with  iV  >  0.  Since  (see  [B3]) 

vec"‘[(S@S)  vec  iV]  =  SA/S’' ^  0  (5.11) 

and 

(S‘®S*)(S@S)  =  S*^‘@S*^',  (5.12) 

it  follows  that 

vec-^[e^®^  vec  iV]  =  f  (A:!)-‘S‘'(VS*^  >  0.  (5.13) 

t=o 


Furtherrnore, 


vec“^  vec  (V]  =  vec"‘  [(e^  ®  e^)  vec  A/]  =  >  0.  (5. 14) 


Applying  (5. 13)  and  (5.14)  alternately  with  (5.10)  and  using  induction  on  k  it  follows 
that  the  integrand  of(5.9)  is  nonnegative  definite.  To  prove  the  converse,  note  that 
it  follows  from  (5.5)  that  J  satisfies 

J  =  vec"‘ [e“'‘ vec  J]  +  J  vec"*  [c'®'*  vec  F]  ds,  te[0,  m).  (5.15) 

Since  the  integral  term  on  the  right-hand  side  of  (5.15)  is  nonnegative  definite,  is 
bounded  from  above  by  and  Fe  {^"  is  arbitrary,  it  follows  that  s-/  is  asymptoti¬ 
cally  stable.  ■ 


Proposition  5.2  shows  that  a  solution  of  (5.5)  exists  as  long  as  Xi, ...,  Xp  are 
sufficiently  small  so  that  remains  stable  for  some  a  >  0.  The  following  result 
characterizes  values  of  a,, Xp  for  which  4/  is  asymptotically  stable.  Let  11 -jl 
denote  an  arbitrary  vector  norm  and  its  induced  matrix  norm. 

Proposition  5,3.  Let  (/!«,  Q.)  be  given,  assume  A  is  asymptotically  stable,  and 

let  a. Xp  >  0.  // 

(/T ©  /T)-*  ^x/„-.  +  f  Vi Af  @  /If j  i  <  I ,  (5. 1 6) 

then  there  exists  satisfying  (5.5)  and  .n/  is  asymptotically  stable. 


Proof,  Define  {,2fc}”=o  where  .Sq  satisfies 

0  =  AJo  +  +  K 

and  i*.,,  satisfies 

0  =  C5)  +  F. 

Note  that  S  0,  /:  =  1,2 . Hence  it  follows  that 

vec  d*+i  -  vec  =  -(A©  /r)"'[vecQ(J^,  CJ  -  vecDli^.,,  B.,,  CJ] 
and  thus 


ijvec 


-k-i-l 


-  vec  iJI  ^ 


_  _V! 

[A  ©  /T)"*  ( a/„-:  -r  X  •/.A;  ®  Aij  j  ijvec  -  vec  ,|. 
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Using  (5.16)  it  follows  that  2.  ^  liinjk_„  2^,  exists.  Thus  2>0  satisfies  (5.5).  Further¬ 
more,  since  Ve  can  be  considered  arbitrary.  Proposition  5.2  implies  that  s/  is 
asymptotically  stable.  ■ 

6.  Necessary  Conditions  for  the  Auxiliary  Minimization  Problem 

The  derivation  of  the  necessary  conditions  for  the  Auxiliary  Minimization  Problem 
is  based  upon  the  Fritz  John  form  of  the  Lagrange  multiplier  theorem.  Application 
of  this  theorem  requires  that  we  further  restrict  (2,  A^.  Be.  ^c)  to  the  open  set 

SA  ^  {{2,  /!„  Be,  Ce):  .2  e  P",  is  asymptotically  stable, 

and  (Ac,  CJ  is  controllable  and  observable}. 

As  will  be  seen,  the  constraint  (2,  A^,  B^,  Q)  eSA'is  not  required  for  either  robust 
stability  or  robust  performance  since  Proposition  4.1  shows  that  only  (3.4),  (3.5), 
and  (4.2)  are  needed.  Rather,  the  set  5^  constitutes  sufficient  conditions  under  which 
the  Lagrange  multiplier  technique  is  applicable  to  the  Auxiliary  Minimization 
Problem.  Specifically,  the  condition  2>0  replaces  (4.2)  by  an  open  set  constraint, 
the  asymptotic  stability  of  js'  serves  as  a  normality  condition  which  further  implies 
that  the  dual  ^  of  .2  is  nonnegative  definite,  and  (A^,  B^,  C^)  minimal  is  a  non¬ 
degeneracy  condition  which  implies  that  the  lower  right  x  subblocks  os'  2  and 
2^  are  positive  definite  thus  yielding  explicit  expressions  for  B^  and  Q.  Note  that  by 
Proposition  5.2  the  condition  that  s/  be  asymptotically  stable  also  implies  that  (5.5) 
has  a  unique,  nonnegative  solution.  Finally,  we  point  out  that  the  stabilizabiifty 
condition  (3.5)  and  stability  condition  (3.6)  play  no  role  in  determining  solutions  of 
the  Auxiliary  Minimization  Problem. 

In  order  to  state  the  main  results  we  require  some  additional  notation  and  a 
lemma  concerning  pairs  of  nonnegative-definite  matrices.  For  a  real  ii  x  ii  matrix 
Z  define  the  set  of  real  diagonalizing  matrices 

^(Z)  ^  {'P  e  0?'”'":  'P-'Z'P  is  diagonal}, 

and,  for  a  pair  of  n  x  n  symmetric  matrices,  X,  Y  define  the  set  of  real  conira- 
grediently  diagonalizing  matrices 

'g’(Z,  y)  ^  {'F  e  9{XY):  and  'P^yM'  are  diagonal} 

and  the  subset  of  real  balancing  transformations 

MX,  Y)  ^  {We MX,  Y):  'P-'Z'P"'^  =  'P^yH'}. 

Of  course,  a  necessary  condition  for  MX,  Y)  to  be  nonempty  is  that  X,  Y,  and 
XY  all  have  the  same  rank.  Note  that  in  general 

MX,  Y)  c  MX,  Y)ci  MX  y).  (6. 1 ) 

Obviously,  a  diagonalizable  matrix  is  either  invertible  (has  no  zero  eigenvalues)  or 
has  semisimple  zero  eigenvalues.  Hence  if  MZ)  #  0.  then  the  group  generalized 
inverse  exists  as  a  special  case  of  the  Orazin  generalized  inverse  [CM].  Note 
that  we  limit  our  consideration  to  diagonalizable  matrices  with  real  eigenvalues. 
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Also,  note  that  there  is  no  assumption  here  that  Z  is  symmetric.  Of  course,  when  Z 
is  symmetric  the  group,  Drazin,  and  Moore- Penrose  generalized  inverses  coincide. 

Lemma  6.1.  Let  Q,Pe  and  let  r  =  rank  QP.  Then  the  following  statements  hold: 

(i)  QP  has  nonnegative  eigenvalues. 

(ii)  'm,P)^0. 

(iii)  QP  is  diagonalisable. 

(iv)  The  n  X  n  matrix 


r  4  QP(QP)*  =  {QP)*QP 

(6.2) 

is  idempotent,  i.e.,  zisan  oblique  projection,  and 

rank  t  =  r. 

(6.'i 

(v)  There  exist  G,  F  e  R*"*"  and  invertible  M  6  such  that 

QP  =  G^VfF, 

(6.4) 

FG^  =  /,. 

(6.5) 

(vi)  //  G,  F  6  R'’*"  and  M  e  E'’*'’  satisfy  (6.4)  and  (6.5),  then 

rank  G  =  rank  F  =  rank  M  —  r. 

(6.6) 

(<2P)*  =  G^W'F, 

(6.7) 

T  =  G^F, 

(6.S) 

zG^  =  G\  Fr=F. 

(6.9) 

(vii)  The  matrices  G,  F  e  E*’*"  and  M  e  satisfying  (6.4)  and  (6.5)  are  unique 

except  for  a  change  of  basis  in  E^  Furthermore,  all  such  M  are  diagonaliz~ 
able  with  positive  eigenvalues. 

(viii)  If  rank  0  =  rank  P  =  r,  then  ^?(Q,  P)r0  and 

6  =  zQ  =  Qz^  =  zQz\ 

(6.10) 

p  =  z'^P=Pz=  z^Pz. 

(6.11) 

Proof.  See  Appendix  A. 

■ 

A  triple  (G,  iVf,  F)  satisfying  (6.4)  and  (6.5)  with  G,  F  e  R'’*",  M  e  R'’*'.  and 
r  =  rank  QP  is  called  a  projective  factorization  of  QP.  In  particular,  we  set  r  =  n^. 
Furthermore,  define  the  complementary  projection 

-  4  - 

(6.12) 

and.  for  arbitrary  Q,  P,Q,Pe  C,  F  e  e  e  and  a  >  0. 

define  the  following  notation; 


^2,  ^  ViCQCe  -r  Q)CJ  -r  D^CJQrCjDJl 

■  ■I 

Rz^^Rz+t  yiZRJiR  +  R)R!  -5-  DjBjGPG^B^Dil 
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Q,  4  QC^  +V^2+t  yilMQ  +  QKI  +  AiQrCjDjl 

i=l 

P,  4  B^p  +  R[2  +  t  'MP  +  -  DJBJGPA,}, 

Aq^A,-Q,V2Z^C,  Ap^  a,-  BR2IPS. 

The  above  definitions  are  for  convenience  in  stating  the  necessary  conditions  for 
the  Auxiliary  Minimization  Problem.  This  result  provides  explicit  formulae  for 
extremals  (^,  A^,  CJ  of  the  Auxiliary  Minimization  Problem.  A  partial  converse 
shows  that  this  form  of  the  necessary  conditions  represents  no  loss  of  generality  with 
regard  to  the  constraint  equation  (5.5). 


Theorem  6.1. 


(I)  Suppose  (2,  Ae,  Be,  Q)  e  ^  solves  the  Auxiliary  Minimization  Problem  with 
given  by  (5.1)  and  Q  given  by  (5.3).  Then  there  exist  Q,  P,  Q,  Pe  N" 
such  that,  for  some  projective  factorization  (G,  M.  T)  of  QP.  (.^.  /Ij.  B^,  C^) 
are  given  by 


Q  +  Q 
.  PQ 


er  ■ 

rer^J’ 


A,  =  r{A  -  BR-JP,  -  +  Q,VffDR;JP,)G\ 


Bc  =  rQ,Vfs\ 

Q  =  -Rh^P,G\ 

and  such  that  Q,  P.  Q,  and  P  satisfy 


(6.13) 

(6.14) 

(6.15) 

(6.16) 


0  =  +  QA:  +K  +  Z  VilAiQAj  +  -  BiR2jP,)Q{Ai  -  B^R-JPf] 


|s»l 


Q^Vfs'QJ  +  ^iQsVu'QM, 


(6.17) 


0  =  AlP  +  PA,  +  R,  +  t  yiL^JP^i  +  Mi  -  Q.VzVQfPiA,  - 


-  PJR-JP,  +  xlPjR^JPsn,  (6.18) 

0  =  ApQ  +  QAJ  +  Q^VffQj  -  (6.19) 

0  =  /ij  F  +  pAq  +  p;  p,  -  tI  pf  r,V  p,xj_  ,  (6.20) 

rank  Q  =  rank  P  =  rank  QP  =  n,..  (6.21) 


Furthermore,  the  auxiliary  cost  is  given  by 


/(£,  A„  Be,  Ce) 

=  tr[(2  +  Q)R,  -  2R,,R;,‘P,e  +  PjR^jR.RyJPM  (6.22) 

(II)  Conversely,  if  there  exist  Q,  P,  Q,  P  e  r'a"  satisj'ying  (6.17)-(6.21)  with  Be  and 
Cc  given  by  (6.15)  and  (6.16),  then  (,d,  .dj.  Ce)  given  by  (6.13)-(6.I6)  satisfy 
(4.2)  and  (5.5)  with  /(i.  A,.,  Be,  Ce)  given  by  (6.22). 
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Proof.  See  Appendix  B.  ■ 

Remark  6.1.  Theorem  6.1  presents  necessary  conditions  for  the  Auxiliary  Minimi¬ 
zation  Problem  which  explicitly  characterize  extremal  quadruples  (J,  A^,  Q). 

These  necessary  conditions  consist  of  a  system  of  two  modified  Riccati  equations 
and  two  moduled  Lyapunov  equations  coupled  by  both'  the  optimal  projection  t 
and  uncertainty  bounds.  If  the  uncertainty  bounds  are  deleted,  then  the  resuls  of 
[HB]  are  recovered. 

Remark  6.2.  When  solving  (6.17)-(6.21)  numerically,  the  uncertainty  terms  can 
be  adjusted  to  examine  tradeoffs  between  performance  and  robustness.  Specifically, 
the  bounds  a,-  and  the  structure  matrices  /I,-,  B,,  Q,  and  /),■  appearing  in  K,,  Rjj*  Qs> 
and  Pj  can  be  varied  systematically  to  determine  the  region  of  solvability  of  (6.17)- 
(6.21). 

Remark  6.3.  Although  (6.17)-(6.21)  appear  formidable,  they  are,  in  fact,  quite 
numerically  tractable.  For  related  problems  involving  coupled  Riccati  equations, 
homotopic  continuation  methods  have  been  shown  to  be  efiective  [KLJ],  [MB]. 
Similar  algorithms  for  solving  (6.17)-{6.21)  have  been  developed  in  [GH],  [Rl], 
and  [R2],  while  iterative  algorithms  are  discussed  in  [G2],  [GV],  and  [CY]. 

Remark  6.4.  Because  of  the  presence  of  and  Q  in  the  definitions  of  F25.  ^2s> 
and  Fj,  the  optimality  conditions  (6.17)-(6.20)  are  couplled  with  the  gain  expressions 
(6.15)  and  (6.16)  for  B^  and  C^.  When  the  problem  is  specialized  to  the  case  D,  =  0, 

I  =  1 . p,  this  coupling  disappears  and  (6.17)-(6.20)  can  be  solved  without 

reference  to  the  gain  expressions  (6.15)  and  (6.16). 


7.  Sufficient  Conditions  for  Robust  Stability  and  Performance  ■ 

In  this  section  we  combine  Theorem  3.1  with  Theorem  6.1(11)  to  obtain  our  main 
result  guaranteeing  robust  stability  and  performance. 

Theorem  7,1.  Assume  there  exist  Q,  P,  Q,  PbM"  satisfying  (6.17)-(6.21)  with 
Be  and  given  by  (6.15)  and  (6,16).  Then,  with  {.2,  A,.,  B..,  CJ  given  by  (6.13)- 
(6.16).  {A  +  AA,[_V  +  n(J,  B,„  C,)  -{AAJ  +  MA'^)V'^)  is  stabilizable  for  all 
(AA,  AB,  AC,  AD)  e  if  and  only  if  A  +  AA  is  asymptotically  stable  for  all 
(A/4,  AB,  AC,  AD)  e  'U.  In  this  case,  the  performance  (2.7)  of  the  closed-loop  system 
(2.9)  satisfies  the  bound 

J{A„  Be,  Ce)  ^  tr[(Q  -b  2)B,  -  IR^.R-JP.Q  +  Pjk,,‘ R.R-J P^  (7.1) 

Proof,  The  converse  portion  to  Theorem  6.1  implies  that  i  given  by  (6.13)  is 
nonnegative  definite  and  satisfies  (5.5)  or,  equivalently,  (3.4).  It  now  follows  from 
Theorem  3.1_that  the  stabilizability  condition  (3.5)  is  equivalent  to  the  asymptotic 
stability  of  .4  +  A.4  .("or  all  (A.l,  AB,  AC,  AD)  e  2(.  In  this  case  Proposition  4.1  yields 
robust.stability  and  performance.  The  robust  performance  bound  (7.1)  is  a  restate¬ 
ment  of  (4.3)  utilizing  (6.22).  ■ 
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Note  that  Theorem  7.1  is  constructive  in  nature  rather  than  existential.  Speci¬ 
fically,  Theorem  7.1  involves  a  coupled  system  of  modified  Riccati/Lyapunov 
equations  (6.17)-(6.21)  whose  solutions,  when  they  exist,  are  used  explicitly  to 
construct  the  dynamic  feedback  gains  (6.14)-(6.16)  which  are  guaranteed  to 
provide  both  robust  stability  and  performance.  The  following  existence  result 
concerns  the  solvability  of  (6.17)-(6.21).  Let  denote  the  dimension  of  the  un¬ 
stable  subspace  of  the  plant  dynamics  matrix  A. 

Theorem  7.2.  Assume  >  «„,  Ri  >  0, 1^,  >  0,  suppose  the  nominal  plant,  i.e.,  (2.1), 
(2.2)  with  a,  =  0,  /  =  1,  ....  p,  is  stabilizable  and  detectable  and,  in  addition,  is 
stabilizable  by  means  of  an  nfh-order  strictly  proper  dynamic  compensator  (2.3),  (2.4). 
Then  there  exist  ... ,ap  >0such  that  ifatS  [0,  a,),  i  =  1, ...,  p,  then  (6.17)-(6.21) 
have  a  solution  Q,  P,Q,Pe  M"for  which  (A^  Cj)  given  by  (6.i4)-(6.16)  solves  the 
Robust  Stability  Problem  with  robust  performance  bound  (6.22). 

Proof.  From  Theorem  3.1  of  [Rl]  and  [R2]  it  follows  that  there  exists  a  solution 
to  (6.17)-(6.21)  which  stabilizes  the  nominal  plant.  By  continuity  there  exists  a  neigh¬ 
borhood  over  which  robust  stability  with  performance  bound  (6.22)  holds.  ■ 

• 

Theorem  7.2  is  an  existence  result  which  guarantees  solvability  of  the  sufficiency 
conditions  over  a  range  of  parameter  uncertainties.  The  actual  range  of  uncertainty 
which  can  be  bounded  and  the  conservatism  of  the  performance  bound  are,  of 
course,  problem  dependent. 


8.  Specialization  to  Full-Order  Dynamic  Compensation 

To  0  aw  connections  with  standard  full-order  LQG  theory,  we  specialize  the  results 
of  Sections  6  and  7  to  the  full-order  case,  i.e.,  n,,  -  n.  As  discussed  in  [HB],  in  the 
mil-order  case  G  =  r"‘  and  thus  G  =  F  =  t  =  /„  and  tx  =  0  without  loss  of  gen¬ 
erality.  To  develop  further  connections  with  standard  LQG  theory  assume 

r,2=0,  Vi2  =  0,  D  =  AD  =  0.  (8.1) 

Since  A£>  =  0  we  write  (A/4,  AS,  AC),  in  place  of  (A,4,  AB,  AC.  AD).  Also,  for  arbi¬ 
trary  Q,  P,  Q,  P  e  R"**"  and  a  >  0  define  the  following  notation; 

Vis  +  t  7.Q(2  +  Q)C7,  '  ^  R,  +  f  y^BllP  -b  P)B,., 

i=i  f=i 

Qs  ^QC^+t  yiMQ  +  &CJ,  P,  ^B-^P+t  y..BT(P  -t-  P)A.„ 


Aq  ^  a,-  qAVC, 


Ap  ^  A,  -  BRL'P,. 


Theorem  8.1.  Let  Wj  =  «,  assume  (8.!)  is  .satisfied,  and  assume  there  exist  Q,  P,  Q, 
P  6  fd"  satisfying 

0  =  A,Q  +  QA]  +V,  +  t  ViLAiQAj  -t-  (,4,  -  B,RJ,‘P,)2(/4i  -  B..R,-'P/] 


-QsVfs^Ql 


(8.2) 
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0  =  AlP  +  P A, +  R,  +  t  '/iLAjPA,  +  Mi  -  QA~s%yHAi  -  QA's'Q)-] 

i=i 


-PjRiiP,, 

(8.3) 

0  =  ApQ  +  eij  + 

(8.4) 

0  =  -b  PAq  +  PjR^lPs, 

and  let  (5,  A^,  B^,  Q)  be  given  by 

(8.5) 

-p;"  a 

(8.6) 

A,  =  A-  BR^lP,  -  QfifC, 

(8.7) 

Be  =  QsViV, 

(8.8) 

(8.9) 

Then,  (<4  +  AA,  [P  +  £2(5,  Q)  -  (A<45  +  5A-4^)*'^])  is  stabilizable  for  all 
(A/1,  AB,  AC)  s  ^  i/  and  only  if  A  +  A  A  is  asymptotically  stable  for  all  (A/1,  AB,  AC) 
e  In  this  case  the  performance  of  the  closed-loop  system  (2.9)  satisfies  the  bound 


J{A,,  B.,  Q)  ^  tr[(0  +  Q)R,  +  PJR-,^R,R^}pM  (8-10) 

Proof.  The  proof  follows  from  the  reduced-order  case  given  in  Appendix  B.  ■ 

Remark  8.1.  Theorem  8.1  presents  sufficient  conditions  for  robust  stability  and 
performance  for  full-order  dynamic  compensation.  These  sufficient  conditions  com¬ 
prise  a  system  of  two  modified  Riccati  equations*  and  two  Lyapunov  equations 
coupled  by  the  uncertainty  bounds.  This  coupling  illustrates  the  breakdown  of 
regulator/estimator  separation  and  shows  that  the  certainty  equivalence  principle 
is  no  longer  valid  for  the  LQG  result  with  real-valued  structured  plant  parameter 
variations.  If,  however,  the  uncertainty  terms  /!;,  Bj,  Q  are  set  to  zero,  it  can  be  seen 
that  (8.4)  and  (8.5)  drop  out,  while  (8.2)  and  (8.3)  reduce  to  the  standard  separated 
Riccati  equations  of  LQG  theory. 

9.  Illustrative  Numerical  Example 

To  demonstrate  the  above  results  we  present  an  illustrative  numerical  example. 
The  example  chosen  was  originally  used  by  Doyle  [D]  to  illustrate  the  lack  of  a 
guaranteed  gain  margin  for  LQG  controllers.  This  example  was  also  considered  in 
[BGl]  for  a  preliminary  robustness  study.  Define 


11 

.J 

n  =  2. 

m  =  1  =  p  =  1, 

'=’1 

II 

Co 

II 

1'" . \ 

C  =  [l 

0], 

D  =  0, 

0 

II 

1  1 
0  0 

1  1 

II 

l],  C,  =  [0 

0], 

D,  =  0, 
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Note  that  the  system  is  open-loop  unstable  and  becomes  unstabilizable  at  cr,  =  —  I. 
As  can  easily  be  seen  using  root  locus,  a  strictly  proper  stabilizing  controller  must 
be  of  at  least  second  order.  Hence  we  consider  (6.17)-(6.21)  with  =  n  and  thus 
T =  0.  Using  algorithms  described  in  [GH]  and  [R 1],  controllers  were  obtained  for 
(a,  aj  =  (0.1, 0.1),  (0.4, 0.2),  and  (1.6, 0.4).  Figure  1  compares  the  guaranteed  robust 
stability  region  to  the  actual  robust  stability  region.  Note  that  the  design  approach 
yields  greater  stability  than  is  guaranteed  a  priori.  This  phenomenon  is  not  sur¬ 
prising  since  even  the  LQG  result  may  provide  arbitrarily  high  levels  of  robustness 
for  particular  problems  while  failing  to  guarantee  even  minimal  robustness  for  all 
problems.  These  results  thus  demonstrate  the  ability  of.the  theory  to  robustify  the 
LQG  result.  Interestingly,  the  form  of  the  actual  stability  region  mimics  the  classical 
6  dB  downward/infinite  dB  upward  gain  margin  of  full-state-fcedback  LQR  con¬ 
trollers.  Finally,  Figure  2  compares  guaranteed  closed-loop  performance  to  actual 
closed-loop  performance  over  the  guaranteed  closed-loop  robust  stability  region. 
Controller  gains  are  given  in  Table  1. 
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Fig  1 


Robust  Stability  and  Pcrfortnanco 


157 


Fig.  2 


Table  1 


(5t.Xl)  /le  Bj  Ce 

(0.1. 0.1) 

■- 14.917  1.0  1 

_-85.177  3.9657] 

[15.9171 

[79.959J  t->5.2182  -4.9657] 

(0.4, 0.2) 

■  -17.963  1.0  1 

133.65  -4.46I4J 

■  18.963" 
.127.05  . 

[-6.6011.  -5.4614] 

(1.6, 0.4) 

-47.813  I.O  I 
1087.3  -6.5463] 

48.813' 

.1073.5 

[-13.766  -7.5463] 
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Appendix  A.  Proof  of  Lemma  6.1 

(i)  Clearly  QP  and  have  the  same  nonzero  eigenvalues.  Since  P'  -QP'  -  is 

nonnegative  definite,  QP  has  nonnegative  eigenvalues. 
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(ii)  The  result  follows  from  Theorem  6.2.5  of  [RM],  p.  123.  See  also  Theorem  4.3 
of[Gl]. 

(ill)  This  result  follows  from  (ii)  and  (6.1). 

(iv)  This  result  follows  from  the  definition  of  the  group  generalized  inverse  (see 

[CM]).  Alternatively,  let  QP  =  where  ‘P  e  ^{QP),  D  =  diag{di, 

Then  {QP)*  =  where  D,f =  l/di  if  d,  ^  0,  and  =  0,  if  d,  =  0,  /  =  1, 

Hence  QP{QP)*  =  is  idempotent,  where  £  is  a  diagonal  matrix  with 

r  ones  and  n  —  r  zeros  on  the  diagonal/'Clearly,  (^.3)  is  valid. 

(v)  Without  loss  of  generality  choose  'P  in  the  preceding  argument  so  that 

D  =  block-diag(A  0„_,),  where  D  =  diag(^, , , . . ,  >  0,  i  =  1, . . . ,  r.  Hence 


”rt-p  „ 


and  thus  (6.5)  holds  with 

G  =  Ur  0,,<„-„]‘pT  M  =  D,  ■  r  =  [/,  0,,,„_,,]'P-‘. 


(vi)  Sylvester’s  inequality  and  (6.4)  imply  that 

r  =  rank  QP  ^  (rank  G,  rank  M,  rank  F}  <  r, 

which  yields  (6.6).  The  expression  (6.7)  for  (QP)***  follows  directly  from  the  definition 
of  the  group  generalized  inverse.  Furthermore,  (6.2),  (6.5),  and  (6.7)  imply  (6.8),  while 
(6.5)  and  (6.8)  imply  (6.9). 

(vii)  Let  both  (G,  M,  F)  and  an  identically  dimensioned  triple  (G,  M,  f)  satisfy 
(6.4).  Then  it  is  easy  to  verify  that  G  =  S“^G,  M  —  SMS~^,  and  f  =  SF,  where 
S  =  FG^  and  S-‘ =  FGT 

(viii)  It  follows  from  (ii)  that  there  exists  T  6  ‘^{Q,  P)  such  that 


A  —  'vl  |u/T  5  _  IM-tI  ®<-x(<i-r)  1  m-i 

k-OXr  0„_,  J  ’  “  K-OX,  0„.,  J  ’ 

where  Dq  and  Dp  are  positive  diagonal.  Define 

L  0(n-r)xr  ^n-r  J 

0rx(«-r)  1 

L  ^(n-r)Xr  ^n-r  J 

and  thus  T  6  ^(Q,  P).  Finally,  (6.10)  and  (6.1 1)  are  immediate. 


so  that 


Appendix  B.  Proof  of  Theorem  6.1 

To  optimize  (4.10)  over  the  open  set  subject  to  the  constraint  (5.5),  form  the 
Lagrangian 

m  C„  &>, ;.)  ^  tr  +  [-4,  J  +  f  -  (B-l) 
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where  the  Lagrange  multipliers  A  S  0  and  e  are  not  both  zero.  We  thus 
obtain 

+  X  yiAj^A,  +  ).R.  (B.2) 

oai  i=i 

Setting  a^jaSl  =  0  yields 


or,  equivalently, 


0  =  Al9  +  '^A^  +  X  yiAj9Ai  +  >.R 

i=l 


ja/T  ygg  0>  =i  —X  vec  R. 


Since  sJ  is  assumed  to  be  stable,  is  invertible,  and  thus  A  =  0  implies  .3®  =  0. 
Hence,  it  can  be  assumed  without  loss  of  generality  that  A  =  1.  Furthermore,  it 
follows  from  Proposition  5.2  with  si,  V  replaced  by  R  that  ^  is  nonnegative 
definite. 

Now  partition  n  x  n2,&  into  n  x  n,n  x  n^,  and  x  subblocks  as 

Hit]  "={4^;} 

and  define  the  positive-definite  matrices 

Vis  ^^z+t  yilQQiCj  +  AQQzCjDn, 

Rzs  ^Rz+t  yilBlPiB,  +  DjBjP,B,D:2. 

|8| 

Thus,  the  stationarity  conditions  for  A^,  B^,  Q  are  given  by 

^  =  PlzQiz  +  PzQz=0,  (B.4) 


—  =  P.B^V,,  +  {PJ,Q,  +  P,Q],)C^ 


PJz  yi2  +  tyi('^iQiCl  +  A,Q,:,CjDj)  =0.  (B.5) 

__  i=I 


=  R2sCgQ2  -f  B  {PiQi2  +  P izQz) 

+  [R]z+tjiiBjPiAi  +  DjBjPj2Ad'jQ,2  =  0-  (B.6) 

Expanding  (5.5)  and  (B.3)  yields 
0  =  /l,ei  +  +  BC,Q]2  + 

-i-  X  yM,Aj  +  BiC.QliAj  +  B..QQ,CJb7]  +  F„  (8.7) 

1*1 


160 


D.  S.  Bernstein  and  W.  M.  Haddad 


0  =  -4,212  +  Q^.Al  +  Q^zCjD^Bl  +  Q,C^B:  +  BCJ2i 

+  I  -liLAiQ.ClBl  +  A,Q,^ClDjBl-^  +  V,.Bl  (B.8) 

I'al 

0  —  ■4ca22  +  22-41,  +  -60^212  +  2T2^^-5j  +  BgDCcQj, 

+  Q,  CJD^BJ  +  B,  (B.9) 

0  =  AlPi  +  Pi  A^  +  C^BJPJ,  +  Pi2B^C 

+  t  •/iC‘4Tp, Ai  +  CjBjPj^Ai  +  AjPi^B.Q  +  CTbJP,B,Q]  +  P„  (B.IO) 

■=i 

0  =  A1Pi2  +  P,2-4„  +  PiiBcJOQ  +  PiBC,  +  C^BjP, 

+  I  '/iLAjPi BiQ  +  AjPi2B,D,C,-]  +  R12C,,  (B.l  1) 

1^1 

0  =  A1,P2  +  K/l„  +  CJB^P,2  +  P/'zBQ  +  CjD^BjP,  +  PjBc^Q 

+  CjP,,Q.  (B.l  2) 

Lemma  B.I.  0,  positive  definite. 

Proof.  By  a  minor  extension  of  results  from  [A],  (B.9)  can  be  rewritten  as 
0  =  (/1„  +  B,DC,  +  B,CQi2Qt)Q2 

+  22{-4ca  +  B,DC,  +  BcC2i222  f  +  B,  1^2,BJ, 
where  Ql  is  the  Moore-Pcnrose  or  Drazin  generalized  inverse  of  22-  Next  note 
that  since  (/!„,  BJ  is  controllable  then,  by  Theorem  3.6  of  [W'],  (^„  +  B^DCc  + 
BcCQi2Q2<  Be  ^zJ")  is  also  controllable.  Now,  since  Q2  and  B^  K^jBj  are  nonnegative 
definite,  it  follows  from  Lemma  12.2  of  [W],  that  22  'S  positive  definite.  Using  (B.  1 2). 


similar  arguments  show  that  P,  is  positive  definite. 

■ 

Since  R,,,  I-',,,  Q2,  and  P,  are  invertible,  (B.4)-(B.6)  can  be  written  as 

—  Pz^PlzQllQz^  =  In,’ 

(B.13) 

Be=  -Pf‘| 

\(PjzQi  +  B22!2)C^ 

It 

+  PJz^^iz  +  i  ViiAiQiCj  +  -4..2i2CjBT)j| 

(B.14) 

C,=  -RTj\ 

[b^(Pi2|2  "h  P1222) 

+  [bT2  +  t  ■Ai.BjPiA;  +  BTBJP[2/I,)j2i2|2.“'.  (B.15) 

Now  define  the  n  x  n  matrices 

2^2.-2i222‘2T2.  P^Pi-Pi2Pf^Pj2. 

Q^QizQVQlz,  P^PizPi'PL 

-QizQVPrPJi, 
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and  the  x  n,n^  x  n^,  and  n^x  n  matrices 

G  ^  ei‘2l2,  M  ^  Q2P2,  r ^  -Pz^Pjz- 
Note  that  r  =  G^F. 

Clearly,  Q,  P,  Q,  and  P  are  symmetric  and  Q  and  P  are  nonnegative  definite.  To 
show  that  Q  and  P  are  also  nonnegative  definite,  note  that  Q  is  the  upper  left-hand 
block  of  the  nonnegative-definite  matrix  where 


Similarly,  P  is  nonnegative  definite. 

Next  note  that  with  the  above  definitions,  {B.13)  is  equivalent  to  (6.5)  and  that 
(6.4)  holds.  Hence  r  =  G^F  is  idempotent,  i.e.,  =  t.  Furthermore,  it  is  helpful  to 

note  the  identities 


Q  =  =  GTQT2 


=  g-^Q2G, 

P  =  -P.jF  =  -F^Pj-j  =  F^p.F,  (B.16) 

zG^  =  G\ 

rT  =  F, 

(B.17) 

Q  =  tQ, 

11 

(B.18) 

QP  = 

-QnPJz- 

(B.19) 

Using  (B.13)  and  Sylvester’s  inequality,  it  follows  that 


rank  G  =  rank  F  =  rank  Q^2  =  rank  P12  =  n,.. 
Now  using  (B.16)  and  Sylvester’s  inequality  yields 


ttg  =  rank  -l-  rank  G  —  Mc  :<  rank  Q  <  rank  Qu  =  ”c. 

which  implies  that  rank  Q  =  n^.  Similarly,  rank  P  =  n^,  and  rank  QP  =  follows 
from  (B.19).  The  components  of  J  and  ^  can  be  written  in  terms  of  Q,  P,  Q,  P,  G, 
and  F  as 


Qi  =  Q  +  Q, 

p,  =  p  +  p. 

(B.20) 

Qi2  = 

P.2  =  -PG\ 

(B.21) 

Qz  =  reF\ 

P2  =  GPGT 

(B.22) 

The  expressions  (6.13),  (6.15),  and  (6.16)  follow  from  the  definition  of  (B.14)  and 
(B.15).  Substituting  (B.20)-(B.22)  into  (B.7)-(B.12)  yields 


0  =  A,Q  +  QAl  +V,  +  X  y^lAiQAj  +  (A,  -  B,R;JP,)Q(A.,  -  P..PJ,‘P,)T] 

+  ApQ  +  QAl,  '  (B.23) 

0=^LApQ  +  Q(G^A„r  +  Q,V2-'Cf  +  Q,V,-^Qj-]r\  (B.24) 

0  =  F[(GT/1„F  +  Q,V2-'QQ  +  Q{G^A„r  Q,V2:^C)^  +  Q,V2VQl-]r\  (B.25) 

0  =  AjP  +  PA,  +  R^  +  t  '/iZAjPA,  +  [A,  -  Q,V2,^QfP(Ai  -  e,K:l'Q)] 

+  A]^P  +  PAq, 


(B.26) 
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0  =  [4?  +  P(G^A„r  +  BRIiP,)  +  P7R,-‘P,]C\  (B.27) 

0  =  C[(GT/l„r  +  BRTiP/P  +  P{G^/l„r  +  BR-Jp,)  +  P/RJ^PJ  G^.  (B.28) 


Next,  computing  either  r(B.24)-(B.25)  or  G(B.27)-(B.28)  yields  (6.14).  Substitut¬ 
ing  this  expression  for  into  (B.23),  (B.24),  (B.27),  and  (B.28)  it  follows  that 
(B.25)  =  r(B.24)  and  (B.28)  =  G(B.27).  Thus,  (B.25)  and  (B.28)  are  superfluous 
and  can  be  omitted.  Next,  using  (B.23)  +  G’"r(B.24)G  —  (B.24)G  —  [(B.24)G]^ 
and  G^r(B.24)G  -  (B.24)G  -  [(B.24)G]'^  yields  (6.17)  and  (6.19).  Using  (B.26)  + 
rG(B.27)r-(B.27)r-[(B.27)r]'^  and  rG(B.27)r-(B.27)r-[(B.27)r]^  yields 
(6.18)  and  (6.20). 

Finally,  to  prove  the  converse  we  use  (6.13)-(6.21)  to  obtain  (5.5)  and  (B.3)-(B.6). 
Let  A^,  C„  G,  F,  t,  Q,  P,  Q,  P,  2.  be  as  in  the  statement  of  Theorem  6. 1  and  define 
Qu  Qi2.  22>  ^1.  f’i2.  ^2  by  (B.20)-(B.22).  Using  (6.5),  (6.15),  and  (6T6),  it  is  easy  to 
verify  (B.5),  (B.6).  Finally,  substitute  the  definitions  of  Q,  P,  Q,  P,  G,  and  r  into 
(6.17)-(6.20),  reverse  the  steps  taken  earlier  in  the  proof,  and  use  (6.13)-(6.16)  along 
with  (6.5)  and  (6.8)-(6.1 1)  to  obtain  (5.5)  and  (B.3).  Finally,  note  that 


2  = 


X  n,  ,  ffl 

J  Ld 


QUn  r^]. 


which  show  that  2>0  thus  verifying  (4.2). 
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Abstract:  In  a  recent  paper  a  unification  of  the  H^  (LQG)  and  conuol-design  problems  was  obtained  in  terms  of  modified 
algebraic  Riccati  equations.  In  the  present  paper  these  results  are  extended  to  guarantee  robust  and  performance  in  the 
presence  of  structured  real-valued  parameter  variations  (A A,  AB,  AC)  in  the  state  space  model.  For  design  flexibility  the  paper 
considers  two  distinct  types  of  uncertainty  bounds  for  both  full*  and  reduced-order  dynamic  compcnsauon.  An  important  special 
case  of  these  results  generates  Hi/H„,  controller  designs  with  guaranteed  gain  margins. 

Keywords:  Robust  control;  parameter  uncertainty;  tf^infinity  design. 


1.  Introduction 

It  has  recently  been  shown  that  the  solution  to  the  optimal  distirbance  attenuation  problem  can  be 
expressed  in  terms  of  a  pair  of  modified  Riccati  equations  [3,4],  Furthermore,  it  was  shown  in  [3]  that 
H2/H„  design  tradeoffs  can  be  achieved  by  solving  a  coupled  system  consisting  of  three  modified  Riccati 
equations.  As  is  well  known,  the  disturbance  attenuation  problem  can  be  used  to  guarantee  robustness 
with  respect  to  unstructured  plant  uncertainties.  However,  if  plant  uncertainty  is  present  in  the  form  of 
structured  parametric  variations  of  the  state  space  model,  then  alternative  bounding  techniques  are 
required.  The  goal  of  the  present  paper  is  thus  to  extend  the  results  of  [3]  to  include  bounds  on  the  effects 
of  real-valued  structured  parameter  variations. 

In  the  absence  of  an  design  constraint,  robust  stability  and  H2  performance  for  dynamic 
compensator  design  were  guaranteed  in  [1,2]  by  incorporating  quadratic  Lyapunov  bounds  within  LQG 
design  theory.  Two  distinct  bounds  were  considered.  In  [1]  a  quadratic  bound  was  used  while  in  [2]  a  linear 
bound  was  employed.  In  each  case  full-  and  reduced-order  dynamic  compensators  were  characterized  by 
means  of  coupled  systems  of  modified  Riccati  and  Lyapunov  equations. 

To  design  controllers  which  are  robust  with  respect  to  structured  real-valued  parameter  variations 
we  proceed  by  combining  the  results  of  [3]  with  those  of  [1,2].  That  is,  we  derive  coupled  systems  of 
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modified  Riccati  and  Lyapunov  equations  whose  solutions  yield  controllers  whtch  are  guaranteed  to  satisfy 
a  prespecified  H„  attenuation  constraint  for  all  variations  (AA,  AB,  AC%  belonging  to  a  given  uncertainty 
set.  If  the  uncertainty  is  absent  (i.e.,  AA=Q,  etc.),  then  the  results  of  [3]  are  recovered,  while  if  the  H.„ 
constraint  is  relaxed,  then  the  results  of  [1,2]  are  obtained,  luus  the  results  of  [3]  can  be  viewed  as  a 
specialization  of  a  broader  design  theory  which  accounts  for  structured  real-valued  parameter  uncertainty. 
Finally,  we  state  all  results  for  the  case  of  a  fixed-order  (i.e.,  reduced-order)  controller  for  maximal  design 
flexibility.  Extensions  to  even  more  general  design  problems  are  mentioned  in  ^tion  9  but  onutted  here 
for  lack  of  space. 

Notation 


Note:  all  matrices  have  real  entries. 

R,  R'’’^^  R',  E:  real  numbers,  rXj  real  matrices,  R'^*,  expected  value. 

In  iYy  0rxf»  Qr^  ^  identity  matrix,  transpose,  rXs  zero  matrix,  0/-X/- 
S',  M'",  P*":  rXr  symmetric,  nonnegative-definite,  positive-definite  matrices. 
Zi  ^  Z2,  Zi  <  Z,:  Zj  -  Zi  e  1^^  Z,  -  Zi  e  P',  Z,,  Z,  e  SL 
n,  m,  /,  /ig!  positive  integers. 

p,  d,  d„,  q,  q„;  n:  positive  integers;  n  +  n^  (n^^n). 

X,  u,  y,  Xg,  x:  n,  m,  /,  n^,  n-dimensional  vectors. 

A,  A  A;  B,  AB;  C,  AC:  n'X.n;  nXm;  iXn  matrices. 

Ag,  Bg,  Q:  ng  X  ng,  ngXl,  mXng  matrices. 


■  A 

BCg 

‘  AA 

ABCg 

[xg]y  ^  = 

BgC 

,  AA  = 

BgAC 

o„g 

»v(*):  d-dimensional  standard  white  noise. 
Di,  jDj:  nXd,  IX  d  matrices;  D^Dl  =  0. 
Fi,  D.Dj,  D^Dj; 


'  Di  ' 

■  yi 

QiX/ig 

BgD2 

.  y= 

QrjgXn 

BcVzBj 

£„  £,:  qXn,  qXm  matrices;  £^£2  =  0. 

£,  rJ  Rj.  [£i  £iQ].  £,'^£„  EJE^;  R^eP-”. 


R  = 


I^l 


CjR^Cg 


=  £'^£. 


q„Xm  matrices;  £,^£2,5  =  0. 

■^so*  ■^Ioo>  I^Zas'  [£loo  ^ZooQl*  ^Uo^loo’  ^Zx^Zoa- 


R«  = 


R 


lx 


yrt^Xn 


yrjXn^ 


cjRzxQ 


=  eZEx- 


Aco.  I^zx-  nxdgg,  lx dgg  matrices;  = 

^t«t  ^Zx-  HlxR^lxy  I^Zx^Zx- 


8 

Vlx 

Dx  = 

,  Vx  = 

^  90 

B^Vz^Bj 

P;  y,  o:  nonnegative  constant;  positive  constants. 
A„  =  A-i-  \al„,  Ag„  =  Ag-i-  ia/„^. 
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2.  Robust  stability  and  H2  performance  with  a  robust  constraint 

In  this  section  we  state  the  robust  stability  and  H2  performance  problem  with  an  H„  disturbance 
attenuation  constraint.  Specifically,  we  consider  a  fixed-order  dynamic  output-feedback  control-design 
problem  with  structured  real-valued  plant  parameter  uncertainties  ’  constrained  disturbance 
attenuation.  This  problem  involves  a  set  U  c  0?'”^''  x  x  '  of  uncertain  perturbations 

(AA,  AB,  AC)  of  the  nominal  system  matrices  (.4,  B,  C).  The  goal  of  the  problem  is  to  determine  a 
fixed-order,  strictly  proper  dynamic  compensator  (A^,  B^,  Q)  which  (i)  stabilizes  the  plant  for  all 
variations  in  U,  (ii)  satisfies  an  constraint  on  disturbance  rejection  for  all  variations  in  U,  and  (iii) 
minimizes  the  wor..,t-case  value  over  the  uncertainty  set  U  of  a  steady-state  H2  performance  criterion.  In 
this  and  the  following  .ection  no  explicit  structure  is  assumed  for  the  elements  of  U.  In  Sections  4  and  7, 
two  specific  structures  of  variations  in  U  will  be  introduced. 

//^-constrained  robust  dynamic  compensation  problem.  Given  the  n-th-order  stabilizable  and  detectable 


plant  with  structured  real-valued  plant  parameter  variations 

x{t)  =  (A+AA)x(t)  +  (B  +  AB)u(t)  +  Diw(:),  (2.1) 

y(/)  =  (C4-dC)x(r)  +  /)2w(/).  (2.2) 

determine  an  /i<.-th-order  dynamic  compensator 

x,(t)=A^Xc(t)  +  ^c)’(0,  (2.3) 

ti(/)  =  Ci.Xg(t),  (2.4) 

which  satisfies  the  following  design  criteria: 


(i)  the  closed-loop  system  (2.1)-(2.4)  is  asymptotically  stable  for  all  (A A,  AB,  AC)  e  V,  i.e.,  A  +  AA 
is  asymptotically  stable  for  all  (A A,  AB,  AC)  e  U; 

(ii)  the  q„Xc/  closed-loop  transfer  function 

^  eJs/,  -  (A  +  A  A)]  "‘3  (2.5) 

from  «'(/)  to  £,„.x(/)  +  E^^uit),  satisfies  the  constraint 

l|/^i4(j)lloo^7>  {AA,AB,AC)^\J,  (2.6) 

where  y  >  0  is  a  given  constant;  and 

(iii)  the  performance  functional 

J{Ac,Bc,Ce)^  sup  Urn  supE[x'’'(/)i?ix(0  +  m^(0^2«(0]  (2-7) 

(d^.nB.nc)eu  f-oo 


is  minimized. 

Note  that  for  each  uncertain  variation  (AA,  AB,  AC)  e  U,  the  closed-loop  system  can  be  written  as 
k{t)  =  iA+AA)x{t)  +  Dwit),  re[0,  co),  (2.8) 

and  that  (2.7)  becomes 

J{A,.,  B,.,  Ce)  =  sup  li.-^  supE[x'^(/)Rx(/)].  (2.9) 

(n/i.nfl,nc)eu  <-« 

Furthermore,  by  defining  the  transfer  function 
H^As)  =  E[sh-iA+AA)]-'D, 
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it  can  be  shown  that  when  (i)  is  satisfied,  (2.7)  is  given  by 

J{A„B^,Q)=  sup  ||^4^-(i)ll2. 

(a.4.as.4C)eu 

Note  that  the  problem  statement  involves  both  and  performance  weights.  In  particular,  the 
matrices  and  are  the  H2  weights  for  the  state  and  control  variables.  By  introducing  the  variables 

z{t)=‘Eix{t),  v(t)  =  E2u(t), 
the  cost  (2.7)  can  be  written  as 

J{Ac,Sc,Ce)=  sup  lim  supE[z^(/)2(0 + 

For  convenience  we  thus  define  7?i  =  E^E^  and  R2  =  E2E2  which  appear  in  subsequent  expressions. 
Although  an  H2  cross-weighting  term  of  the  form  2x^(r)/ii2«(f)  can  also  be  included,  we  shall  not  do  so 
here  to  facilitate  the  presentation. 

For  the  performance  constraint,  the  transfer  function  (2.5)  involves  weighting  matrices  £1^0  and 
£200  ior  the  state  and  control  variables.  The  matrices  i?2oo  “  are  thus  the 

counterparts  of  the  H2  weights  £1  and  £2-  Although  we  do  not  require  that  and  £200  be  equal  to  £i 
and  £2,  we  shall  require  for  technical  reasons  that  £200  =  where  the  nonnegative  scalar  /8  is  a 
design  variable.  We  further  note  that  the  assumption  precludes  an  cross-weighting  term 

which  again  facilitates  the  presentation.  Finally,  similar  remarks  apply  to  the  disturbance  and  sensor  noise 
intensities  V^  =  DyDj,  ^2  =  P2-Oj,  Fiao  =  Aao-Oioo  arid  ^2^  =  £200-0200  for  ihe  H2  and  designs 
respectively.  As  in  [3],  h'(/)  is  interpreted  as  wWte  noise  for  the  H2  design  and  as  an  L2  signal  for  the 
design  aspect. 

Before  continuing  it  is  useful  to  note  that  if  AAtAA  is  asymptotically  stable  for  all  (A A,  AB,  AC)  e  U 
for  a  given  compensator  (A^,  £„  Q),  then  the  performance  (2.7)  is  given  by 


J{A,.,  B,.,  Ce)  =  sup  irQ^^R, 

(2.10) 

(.t\A,AB,/^C)eV 

where  the  steady-state  closed-loop  state  covariance  defined  by 

lim  E[x(r)x'^(r)] 

t~*00 

(2.11) 

satisfies  the  /if  X  algebraic  Lyapunov  equation 

Q={A+  AA)Q^;i  +  +  AA)'^  +  V. 

(2.12) 

The  key  step  in  guaranteeing  robust  stability  and  performance  is  to  replace  the  uncertain  terms  in  the 
covariance  Lyapunov  equation  (2.12)  by  a  bounding  function  Q.  Note  that  since  AA  is  independent  of  A^, 
the  bounding  function  S2  need  only  depend  on  B^  and  Q.  Furthermore,  the  disturbance  attenuation 
constraint  (2.6)  is  enforced  for  all  (AA,  AB,  AC)  e  U  by  replacing  the  modified  algebraic  Lyapunov 
equation  (2.12)  by  an  algebraic  Riccati  equation  which  overbounds  the  closed-loop  steady-state  covariance. 
Justification  for  this  technique  is  provided  by  the  following  result. 

Lemma  2.1.  Let  i2 :  x  x  -♦  S'*  be  such  that 

AAQ  +  QAA^ ^Q{B^,C^,Q),  {AA,  AB,  AC)  &\J,  (£<,,  Q,  Q)  (2.13) 

and,  for  a  given  (A^,  £c>  Q)»  suppose  there  exists  Q  e  1^"  satisfying 
0  =  iQ  -i-  y-^Q£„Q  + 12(  £„  Q,  Q)  +  V. 


(2.14) 
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Then 


{A  +  AA,  b)  is stabilizable ,  (AA,  AB,  4C)eU,  (2.15) 

if  and  only  if 

A  +  A  A  is  asymptotically  stable,  (AA,  AB,  4C)  e  U.  (2.16) 

In  this  case, 

II  II 0=  ^  Y,  i^A,  AB,  AC)  e  U,  (2.17) 

and 

^  Q,  (AA,  AB,  AC)  €  U,  (2.18) 

where  Q^ji  is  given  by  (2.12).  Consequently, 

J(A„  B„  Q)  ^  B„  Q),  (2.19) 

where 

3(A^,  B„C^,Q)^trQR.  (2.20) 

Proof.  First  note  for  clarity  that  in  (2.13)  Q  denotes  an  arbitrary  element  of  1^"  since  (2.13)  holds  for  all 
Q  e  1^",  while  in  (2.14)  Q  denotes  a  specific  solution  to  (2.14).  Now  for  {AA,  AB,  AC)  s  U,  (2.14)  is 
equivalent  to 

0  =  (/:  +  di)Q  +  Q(A  +  AA)'^  +  y'^QRJi  +  Q(B^,  Q,  Q)  ~  (diQ  +  Q^/F)  +  V.  (2.21) 


Hence,  by  assumption,  (2.21)  has  a  solution  QsM'*  for  all  (AA,  AB,  AC)slJ  and,  by  (2.13), 
a(B„  Q,  Q)  -_(^^'Q_+  QdX"’")  is  nonnegative  definite.  Now  it  follows  from  TTieorem  3.6  of  [7]  and 
(2.15)  that  (/T  +  di,  (F+y-2Q««Q  +  12(Bc,  Cc,  Q)-(di’Q  +  Qd/r)]‘/^)_  is  stabilizable  for  all 
(AA,  AB,  dC)eU.  Thus  it  follows  from  (2.21)  and  Lemma  12.2  of  [7]  that  A  +dA  is  asymptotically 
stable  for  all  (A  A,  AB,  AC)  e  U.  Conversely,  ii  A+  A  A  is  asymptotically  stable  for  all  (A  A,  AB,  AC)  e  U, 
then  (2.16)  holds.  The  proof  of  (2.17)  follows  from  a  standard  manipulation  of  (2.14).  Next,  subtracting 
(2.12)  from  (2.20)  yields 

0  =  (A+  AA)(Q  -  +  (Q  -  Q^^)(A  +  AA)'^ 

+Y"'Q«„Q  +  i2(5c,  Q,  Q)  -  (d/Q  +  Qd/F), 
or,  equivalently,  since  A  +  d.,4  is  asymptotically  stable  for  all  (AA,  AB,  AC)  e  12, 

Q  -  QttA  =  +  I2(B^,  Q,  Q)  -  (d/Q  +  Qd/^)]  dr  >  0 

which  implies  (2.18).  The  performance  bound  (2.19)  is  now  an  immediate  consequence  of  (2.18).  □ 

Remark  2.1.  Note  that  (2.15)  is  actually  a  closed-loop  ‘disturbability’  condition  which  is  not  concerned 
with  control  as  such.  This  condition  guarantees  that  the  closed-loop  system  does  not  possess  unstable 
undisturbed  modes. 


3.  The  auxiliary  minimization  problem 

As  shown  in  the  previous  section,  the  replacement  of  (2.12)  by  (2.14)  enforces  the  disturbance 
attenuation  constraint  and  yields  an  upper  bound  for  the  worst  case  H-,  performance  criterion.  That  is. 


398 


A.N.  Madiwale  et  aL  /  Robust  control  design 


given  a  compensator  {A^,  Q)  for  which  there  exists  a  nonnegative-definite  solution  to  (2.14),  the 
actual  worst  case  performance  JiA^,  Q)  of  the  compensator  is  guaranteed  to  be  no  worse  than  the 
bound  given  by  JCA^,  B^,  Q,  Q).  Hence,  J(A^,  5<.,  Q,  Q)  can  be  interpreted  as  an  auxiliary  cost  which 
leads  to  the  following  optimization  problem. 

Auxiliary  Minimization  Problem.  Determine  {A^,  B^,  Q,  Q)  which  minihiizes  J(A^,  B^,  Q,  Q)  subject  to 

(2.14)  with  Q  e 

It  follows  from  Lemma  2.1  that  the  satisfaction  of  (2.14)  for  Q  e  along  with  the  generic  condition 

(2.15)  leads  to  (i)  closed-loop  stability  for  all  (AA,  AB,  AC)  e  U;  (ii)  prespecified  performance 
attenuation  for  all  (A A,  AB,  4C)eU;  and  (iii)  an  upper  bound  for  the  worst  case  ifj  performance 
criterion.  Hence,  it  remains  to  determine  (A^,  B^,  Q)  which  minimizes  J(Ac,  B^,  Q,  Q)  and  thus  provides 
an  optimized  bound  for  the  actual  worst  case  ff2  performance  /(A^,  B^,  Q)  over  all  (A A,  AB,  AC)  s  U. 


4.  Uncertainty  structure:  Linear  bound 


Having  established  the  theoretical  basis  for  our  approach,  we  now  assign  explicit  structure  to  the  set  of 
U  and  bounding  function  S2.  Specifically,  the  uncertainly  set  U  is  assumed  to  be  of  the  form 

U  =  l(AA,  AB,  AC):  AA=  £  a,A„  AB=£  a^B,,  AC^  £  £  a?/af  ^  ll  (4.1) 

V  /-I  (-1  /-I  /-I  ) 

where,  for  /  =  1, . . . ,  p.  A,  e  B,e  r"^"*,  and  C,  e  R'^"  are  fixed  matrices  denoting  the  structure  of 
the  parametric  uncertainty:  a,  is  a  given  positive  number;  and  a,  is  an  uncertain  real  parameter.  Note  that 
the  uncertain  parameters  are  assumed  to  lie  in  a  specified  ellipsoidal  region  in  R The  closed-loop 
system  (2.8)  thus  has  structured  uncertainty  of  the  form 


AA=  where  A,= 


A,  B^C, 


BcCi 


,  i  l,...,p. 


(4.2) 


Note  that  the  symmetry  of  the  uncertainty  set  entails  no  loss  of  generality  by  requiring  only  a  redefimtion 
of  the  nominal  plant  matrices. 

In  order  to  obtain  explicit  gain  expressions  for  (A^,  B,.,  Q)  in  Sections  5  and  6,  we  shall  require  that  at 
most  one  of  the  perturbations  AB  and  AC  is  nonzero.  We  thus  consider  the  cases  (AA,  AC)^IJ  or 
(AA,  AB)  e  U.  If  this  assumption  is  not  imposed,  then  optimality  conditions  can  still  be  derived,  but  at 
the  expense  of  closed-form  gain  expressions.  In  this  section  and  Section  5  we  will  assume  that  JIB  =  0  (i.e., 
B,  =  0,  /  =  1, . . .,  p)  so  that  12(5c,  Q,  Q)  becomes  12(5c,  Q).  The  dual  case  AB  ¥=Q,  AC  =  0  (i.e.,  C,  =  0,  / 
=  1, . . . ,  p)  will  be  considered  in  Section  6. 

For  the  structure  of  U  specified  by  (4.1),  the  bound  12  satisfying  (2.13)  can  now  be  given  a  concrete 
form. 


Proposition  4.1.  Let  a  be  an  arbitrary  positive  scalar.  Then  the  function 

n(B„Q)^aQ  +  a-^£afAiQAf  ,  (4.3) 

/-I 

satisfies  (2.13)  with  U  given  by  (4.1). 


Proof.  See  [2].  □ 
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Remark  4.1.  Note  that  the  bound  i2  given  by  (4.3)  consists  of  two  distinct  terms.  The  first  term  aQ  can  be 
thought  of  as  arising  from  an  exponential  time  weighting  of  the  cost,  or,  equivalently,  from  a  uniform  right 
shift  of  the  open-loop  dynamics.  The  second  term  a~^T,^^itx}A,Q^  arises  naturally  from  a  multiplicative 
white  noise  model.  Such  interpretations  have  no  bearing  on  the  results  obtained  here  since  only  the  bound 
12  defined  by  (4.3)  is  required.  We  call  (4.3)  the  linear  bound  since  it  is  linear  in  Q.  For  a  more  detailed 
discussion  on  (4.3)  see  [2]. 

With  12  defined  by  (4.3),  the  modified  Riccati  equation  (2.14)  becomes 

p 

0  =  /iQ  +  Q/T  +  y'^QRjQ  +  aQ  +  a“‘  E  afA/QAj  +  V  (4.4) 

1-1 

or,  equivalently, 

(4.5) 

i-l 


0  =  ^'aQ  +  Q^T  +  v"'QR«Q  + 


where  5,-  =  af/a  and 


A^  =  A  +  ^alf,  = 


Aa  BQ 
kc  A.„ 


5.  Sufficient  conditions  for  robust  stability  and  performance  with  robust  disUirbance  attenuation:  Linear 
bound 

In  this  section  we  state  sufficient  conditions  for  characterizing  fixed-order  (i.e.,  full-  and  reduced-order) 
controllers  guaranteeing  closed-loop  stability  for  all  (.A /I,  dC)  e  U.  constrained  disturbance  attenua¬ 
tion  for  all  {AA,  AC)  s  U,  and  an  optimized  worst  case  performance  bound,  in  order  to  state  the  main 
results  we  require  some  additional  notation  and  a  factorization  lemma. 

Lemma  5,1,  Let  Q,  F  e  and  suppose  rank  QP  =  n^.  Then  there  exist  n^  Xn  G,  F  and  X  n^  invertible 
M,  unique  except  for  a  change  of  basis  in  R"',  such  that 

QP  =  G'^MF,  FG'^  =  (5.1),  (5.2) 

Furthermore,  the  nXn  matrices 

r^G-^F,  (5.3),  (5.4) 

are  tdempotent  and  have  rank  n^  and  n  -  n^,  respectively.  Finally,  //  P  e  and  )S  >  0  then  the  inverse 

5^(/„-f/3V'eP)"'  ■  (5.5) 

exists. 

For  arbitrary  Q,  and  a  >  0  define  the  following  notation: 

=  ^2  +  1 5/C,(e + 2)c7.  Qs d,Ai(Q+ e)c7, 

/-I  i-i 


2  =  5^2*5'^. 
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Theorem  5.1.  Suppose  there  exists  Q,  P,  Q,  N"  satisfying 

p 

0  =  A,Q  -1-  QAl  +  y-^QR,^Q  +V,+  Z  S,A,{Q  +  Q)aJ  -  Qjq-.^QlrJ ,  (5.6) 

i-i 

0  =  {A,  +  y-^[Q  +  q]  R,„yp  +  P{A,  +  y-^[Q  +  q]  R,„)  +  R, 

+  f  s\AfPAi  +  (/t, -  QsV2sCfi\  - s'^psps  +  tIs'^pspst^  ,  (5.7) 

1-1  ' 

0  =  {A^-  2PS  +  +  Q{A,  -  2PS  + 

+ Y-'2(i?ico  +  ^^S'^P2PS)Q  +  Q.PZ'QI  -  Tx  QsfTs'Qjrl ,  (5.8) 

0  =  (^a  -  +  y-^QRiSP  +  -  QsJ^s'C  +  y-^QRrJ  +  S^P2PS  -  rJS'^PUPSr^  , 

(5.9) 

rank  2  =  rank  ?  =  rank  2^  =  «c,  (5.10) 


and  let  (A^,  Q,  Q)  be  given  by 


A,  =  r{A  -  IPS  -  Qjq-fC  +  y-^QR,^)G\ 
Be  =  rQ,Vfs\ 

Q=  -Rz^B'^PSG'^, 

qJq+q 

[  FQ  r2r\‘ 


(5.11) 

(5.12) 

(5.13) 

(5.14) 


Then  {A  +  A  A,  D)  is  stabilizable  for  all  (AA,  AC)  e  U  if  and  only  ifA+  AA  is  asymptotically  stable  for  all 
(AA,  AC)  €  U.  In  this  case,  the  closed-loop  transfer  function  satisfies  the  //„  disturbance  attenuation 

constraint 


II^4.4(^)II«^Y.  (:i/t,/iC)eU,  (5.15) 

and  the  worst-case  H2  performance  criterion  (2.\0)  satisfies  the  bound 

J{A,,  B„C,)^lv[{Q-t-Q)R,  +  QS'^PIPS].  (5.16)  - 


Proof.  The  proof  follows  from  Lemma  2.1  by  combining  the  proofs  of  Theorem  6.1  of  [3]  and  Theorem  6.1 
of  [2].  □ 


Remark  5.1.  Theorem  5.1  presents  sufficient  conditions  for  designing  controllers  yielding  robust  stability 
and  performance  with  a  constraint  on  the  H„  norm  of  the  closed-loop  transfer  function  for  a  state-space 
system  with  structured  real-valued  pl^t  parameter  variations.  These  sufficient  conditions  comprise  a 
system  of  three  modified  Riccati  equations  and  one  modified  Lyapunov  equation  coupled  by  the  optimal 
projection  t,  the  linear  uncertamty  bound,  and  the  constraint.  If  the  uncertainty  bound  is  deleted,  then 
the  results  of  [3]  are  recovered.  If,  alternatively,  the  uncertainty  terms  are  retained  but  the  constraint  is 
sufficiently  relaxed,  i.e.,  y-*  00,  then  the  results  of  [2]  are  recovered  for  the  case  B,  =  0,  i  =  l,...,  p. 

Remark  5.2.  To  specialize  Theorem  5.1  to  the  full-order  case  =  n,  it  is  only  necessary  to  set  G^  =  r~'  so 
that  G  =  r=T  =  I„  and  =  0  without  loss  of  generality.  Now  the  last  term  in  each  of  (5.6)-(5.9)  can  be 
deleted  and  G  and  F  in  (5.11)-(5.14)  can  be  taken  to  be  the  identity.  It  is  interesting  to  note  that  in  the 
full-order  case  the  design  problem  with  structured  parameter  variations  is  comprised  of  four  coupled 
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Riccati/ Lyapunov  equations.  This  coupling  illustrates  the  breakdown  of  regulator/ estimator  separation 
and  shows  that  the  certainty  equivalence  principle  is  no  longer  valid.  This  is  not  surprising  since  separation 
also  breaks  down  for  the  full-order  result  with  parameter  uncertainties  [2]. 

Remark  5.3.  When  solving  (5.6)-(5.10)  numerically,  the  uncertainty  terms  and  the  constraint  can  be 
adjusted  to  examine  fadeoffs  among  performance,  robustness,  and  disturbance  rejection.  Specifically,  the 
uncertainty  range  a,  and  the  structure  matrices  A„  C,  appearing  in  and  along  with  y  can  be  varied 
systematically  to  determine  the  region  of  solvability  of  the  design  equations  (5;6)-(5.9). 

Remark  5.4.  We  point  out  that  if  j8  =  0  or,  equivalently,  £2*  =  which  corresponds  to  the  ‘cheap’ 
control  case  (i.e.,  attenuation  between  disturbances  and  controls  is  not  constrained),  it  is  possible  to 
obtain  closed-form  gains  (A^,  Q)  given  by  a  modified  set  of  design  equations  when  all  three  of  AA, 
A  5,  and  AC  are  nonzero.  Because  of  space  limitations  this  result  will  be  given  in  a  future  paper. 

Remark  5.5.  An  important  special  case  of  the  results  of  Section  5  is. obtained  by  setting  AA=0,  AB  =  0, 
4C  =  ajCi,  and  Cj  =  C.  The  resulting  H2/H„  design  is  guaranteed  to  possess  a  gain  margin  of  ±100ai 
percent  at  the  sensor  output. 


6.  The  dual  case:  Linear  bound 

Unlike  the  standard  LQG  result  involving  a  pair  of  uncoupled  Riccati  equations,  the  new  result 
guaranteeing  robust  stability,  robust  performance,  and  disturbance  rejection  involves  a  coupled  system 
of  four  modified  Riccati/ Lyapunov  equations.  The  asymmetry  of  these  equations  suggests  the  possibility 
of  a  dual  result  in  which  the  modifications  to  the  standard  Riccati  equations  are  reversed.  One  motivation 
for  developing  such  dual  results  is  that  for  certain  problems  the  dual  bounds  may  be  sharper  than  the 
primal  bound  introduced  m  Section  4.  Furthermore,  the  dual  theory  permits  distinct  disturbance 
weights  and  although  we  now  require  =  R\.  Finally,  the  dual  theory  allows  for  uncertainty 
in  the  control  matrix  B  (i.e.,  AB¥=0),  although  we  now  require  AC  =  0,  (i.e.,  C,  =  0,  /  =  1. . . . ,  p)  to  obtain 
closed-form  gain  expressions  for  (A^,  £<.,  Q).  We  begin  with  the  following  lemma. 

Lemma  6.1.  Suppose  the  system  (2.8)  ts  asymptotically  stable,  for  all  {AA,  AB,  AC)eU  for  a  given 
(Ac,  Be,  Q).  Then 

J{Ac,  Be,  Q)  =  sup  tr  P^^V,  (6.1) 

(a/t.4fl.ac)€U 

where  W"  is  the  unique  solution  to 

0  =  (/I  -t- AAfp^y  +  P^^(A  +  AA)  +  R.  (6.2) 

Proof.  See  (Ij.  □ 

Utilizing  (6.1)  in  place  of  (2.10),  the  disturbance  attenuation  constraint  from  plant  and  sensor 
disturbances  to  the  state  and  control  variables  given  by 

L  =  +  ^^■)1  "'^colL  ^  (^-3) 

can  now  be  enforced  by  replacing  (2.14)  by  the  modified  Riccati  equation 
0  =  +  PA  +  y-^PVcoP  +  P)  +  R, 


(6.4) 
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where 

AA^P  +  PAA^ii{Q,P),  {AA,AB)^V.  ■  (6.5) 

Note  that  (6.4)  is  merely  the  dual  of  (2.14).  We  also  require  the  condition  dual  to  (2.15)  given  by 

(E,  A  +  A  A)  is  detectable  for  all  (A  A,  AB)  e  U.  (6.6) 

For  the  structure  of  U  as  specified  by  (4.1)  with  AC  =  0,  the  bound  Q  satisfying  (6.5)  can  now  be  given  a 
concrete  form. 

Proposition  6.1.  Let  a  be  an  arbitrary  positive  scalar.  Then  the  function 

fl(Q,  P)  ^  aP  +  a-'  £  otjAjPA,  (6.7) 

(-1 

satisfies  (6.5)  with  U  given  by  (4.1)  and  AC  =  0.  With  Q  defined  by  (6.7),  the  modified  dual  Riccati  equation 
(6.4)  becomes 

p 

0  =  ilP  +  PA^  +  y--PV^P  +  E  SiAjPA,  +  R.  ■  (6.8) 


We  can  now  state  sufficient  conditions  for  robust  stability,  robust  H2  performance,  and  robust 
disturbance  attenuation  for  the  dual  problem.  For  arbitrary,  Q,  P,  and  a>0  define  the 

following  notation: 

=  is,B7(P  +  P)B,,  P,^B-^P+  i:8,Bj{P-^P)A,,. 

/-I  /-t 

S^{l„  +  y-^0^QPy\  S-^CVC. 

Theorem  6.1.  Suppose  there  exist  P,  Q,  P,  satisfying  (5.10)  and 

p 

0  =  /ilp  +  PA,  +  7-'pf,„p  +  p,  +  L  M7(p  +  hA,  -  p/PIs'P,  +  tIp7p,-'p,t.  , 

i-l 

Q  =  {A,  +  y-^V,^[P  +  P])Q  +  Q{A,  +  y--V,J^P  ^  P]Y  +  V, 

+  I  S,Ia,QAJ  +  {A,  -  B,R-JP,)Q{A,-  B^R^Jpy]  -  SQSQS''^  +  rjQSQS'^rl , 


(6.9) 


(6.10) 


<-i 


0  =  {A,-  SQI  +  y-^V^„Py  P  -i-  P{A,-  SQS  +  y--Vy,,P)  +y-^P{V,,,  +  li^SQSQS'^)P 

4-P7pj;p,  -  tIp7P7,‘P,t^  ,  (6.11) 

0  =  ( ^„  -  BR-JP,  +  y--V^„P)Q  +  Q{A,-  BRjX  +  Y"-l^,„Pf  +  S'QSQS'^  - SQEQS'^tI  , 

(6.12) 


and  let  (A„  B,,  Q,  P)  be  given  by 

A,  =  r(A-  S'QS-BRjJP,  +  y-^y,„P)G\ 

p,  =  rsec'^Fj-', 

Q=  -RI,^P,G\ 

p^[p  +  P  -PG"^ 

[-GP  CPC'^.' 


(6.13) 

(6.14) 

(6.15) 

(6.16) 
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Then  (E,  A  +  A  A)  ts  detectable  for  all  (*i^,  AB)eV  if  and  only  if  A  +  A  A  is  asymptotically  stable  for  all 
{AA,  AB)  e  U.  In  this  case,  the  closed-loop  transfer  function  H^^{s)  satisfies  the  disturbance  attenuation 
constraint 

I|4^-(^)IL^Y,  {AA,AB)^\i,  (6.17) 

and  the  worst-case  performance  criterion  (2.7)  satisfies  the  bound 

J(>4, ,  Ce)  ^  tr[ ( ?  +  P )  F,  +  PSQEQS'^] .  (6.18) 

Remark  6.1.  The  dual  case  of  Remark  5.5  is  obtained  by  setting  AA  =0,  AB  =  ajP,,  AC  =  0,  and  R,  =  B. 
The  resulting  design  is  guaranteed  to  possess  a  guaranteed  gain  margin  of  ±  100a,  percent  at  the 

input. 


7.  Uncertainty  structure  and  sufficient  conditions  for  robust  stability  and  performance  with  disturbance 
attenuation:  Quadratic  bound 

We  now  assign  a  different  structure  to  the  uncertainty  set  U  and  the  bounding  function  12.  Specifically, 
the  uncertainty  set  U  is  assumed  to  be  of  the  form 

U=  l{AA,  AB,  AC):  AA  =  f  FpMiNiG,,  AB=  ^  FiMiNiH,, 

\  i-l  /-I 

P  _  _ 

AC=  Z  K,MiNiGi,  ^  M„  ^  A(.,  /  =  1 . p 

where,  for /  =  1,...,  p,  <7, and  are  .fixed  matrices  denoting  the 

structure  of  the  uncertainty;  and  are  given  uncertainty  bounds;  and  and 

Nj  e  are  uncertain  matrices. 

In  order  to  obtain  explicit  gain  expressions  for  {A,.,  B,.,  Q)  we  again  consider  two  cases:  (1) 
(AA,  AC)  e  U  with  AB  =  0,  and  (2)  (4/1,  AB)  e  U  with  AC  =  0.  When  AB  =  0  the  closed-loop  system 
has  structured  uncertainty  of  the  form 

p 

AA  =  Z  F.MiNfii,  (7.2) 

1-1 


where 


In  this  case  the  quadratic  bound  12  satisfying  (2.13)  can  now  be  given  a  concrete  form. 

Proposition  7.1.  The  function 

Q)  =  f  FiMiF;^  +  QGjN;G,q  (7.3) 

/-I 


satisfies  (2.13)  with  U  giuen  by  (7.1)  and  AB  =  0. 
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Proof.  See  [1].  □ 

Thus,  with  Q  defined  by  (7.3),  the  modified  Riccati  equation  (2.14)  becomes 

p  _  _ 

0  =  iQ  +  +  y-^QR„Q  +  £  [ +  QGT'iV/G/Q]  +  (7.4) 

1-1 

For  arbitrary  Q  e  define: 

p  _  p  _ 

e, = +  E  FiM,K„  PiMipy, 

i~\  /-I 

V2^ ^v^+z  kMk7,  E^Z  GjNfi,. 

i-1  i-1 

Theorem  7.1.  Suppose  these  exist  Q,  P,  Q,  N"  satisfying  (5.10)  and 


Q=‘AQ  +  QA^  +  y-^QR^^Q  +V,  +  QEQ  +  D-  Q^Vf^Ql  +  Qjq^^QTrJ ,  (7.5) 

Q  =  {A  +  [Q  +  q]  +  £])'"P  +  P(^  +  [Q  +  Q]  [y-%oo  +  ^]) 

+  /?!  -  S'^PEPS  +  tJ  S'^PEPStj^  ,  (7.6) 

0  =  (A-2PS  +  Q[y-%„  +  E])Q  +  Q(A-EPS  +  Qly-%^  +  E])'^ 

+  Q(y-HRi„  +  ^^S'^P2PSj  +E)Q  +  Q,Tq-,^(2j-r^Q,Pr.'QlrI,  (7.7) 

0  =  (^  -  Q.^.'C+Q[r-%cc  +  pjfP  +  P(^  -  Q.fT»C+Q[y-%„+Ej)  +  S^PEPS 

-rJS'^PEPSrj^,  (7.8) 

and  let  Q  be  given  by  (5.14)  and  {A^,  Cf)  by 

A,  =  T{A-  EPS  -  2[r‘'7?,„  +  £l)(7^,  (7.9) 

B,  =  rQ,Vf,\  ■  (7.10) 

Q= -R^^B'^PSG'^.  (7.11) 

Then  (A  +  A  A,  D)  is  stabilizable  for  all  (AA,  AC)  eV  if  and  only  if  A  +  AA  is  asymptotically  stable  for  all 
(A  A,  AC)  e  U.  In  this  case,  the  closed-loop  transfer  function  satisfies  the  H„  disturbance  attenuation 

constraint  ■ 

ll^^4.f(^)llco^Y.  {AA,AC)^V,  (7.12) 

and  the  worst-case  performance  criterion  (2.10)  satisfies  the  bound 

J(A„  B„  Q)  ^  tr[(2  +  Q)Rt  +  QS'^PyiPS].  (7.13) 

Proof.  The  proof  follows  by  combining  the  proofs  of  Theorems  6.1  of  [3]  and  Theorem  8.1  of  [1].  □ 
Remaric  7.1.  It  is  interesting  to  note  that  in  the  full-order  case  n,.  =  n  with  G=r  =  T  =  I„  and  =  0  (see 


Remark  5.1),  P  plays  no  role  so  that  (7.8)  is  superfluous.  Thus,  unlike  the  full-order  result  for  the  linear 
bound  involving  four  equations,  the  full-order  quadratic  bound  involves  three  modified  Riccati  equations 
coupled  by  the  quadratic  bound  and  the  H„  constraint.  If,  alternatively,  the  reduced-order  constraint  is 
retained,  but  the  uncertainty  terms  are  deleted,  then  the  results  of  [3]  are  recovered.  If,  furthermore,  the 
uncertainty  terms  are  retained,  but  the  H„  constraint  is  sufficiently  relaxed,  i.e.,  y  -*  oo,  then  the  results  of 
[1]  are  recovered. 
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8.  The  dual  case:  Quadratic  bound 


For  the  structure  of  U  as  specified  by  (7.1)  with  dC  =  0.  the  closed-loop  system  has  structured 
uncertainty  of  the  form 

(8.1) 

i-t 

where 


F,= 


Ft 


Proposition  8.1.  The  function 

p  _  _ 

fi(Q.  P)  =  I  GJN.Gi  +  PFIM-F/P  (8.2) 

1-1 

satisfies  (6.5)  with  U  given  by  (7.1)  and  AC  =  0. 

With  defined  by  (8.2),  the  modified  dual  equation  (6.4)  becomes 

p  _  _ 

0  =  i^P  +  P^"  +  Y“^PP„P  +  L  [GjNiGi  +  PF;A/,iF;'^P]  +  R.  (8.3) 

i-t 


For  arbitrary  P  s  define: 

p  _  p  _ 

i-i  i-i 

Theorem  8.1.  Suppose  there.exist  P,  Q,  P,  N"  satisfying  (5.10)  and 

Q  =  A'^P  +  PA  +  y-^P.V,„P  +  R^  +  E  +  PDP-  PfRzX  +  rj PjRzXrs.  >  (8.4) 

0  =  (/I  +  [y-^V,„  +  d][P  +  P])Q  +  Q{a  +  [y--V,„  +  D][P  +  P]^  +  F,  - s'qSQS'^ 

+rjQ2QS'^Tl,  (8.5) 

0  =  (.4  -  S'QS  +  [y-^V^„  +  D]pyp  +  P{A-  SQ2  +  [y-^V,„  +  d]  p) 

+  P(7'MF'i<»  +  P^SQ^QS'^]  +  D)P  +  PjR^JP,  -  rlPfR^fP^r^  ,  (8.6) 

0  =  (^  -  BR^X  +  [y"'^'ico  +  D]  P)Q  +  Q{a  -  BRllP^  +  +  i>]  P)""  +  solas'^ 

-rjQ2QS\l,  (8.7) 

and  let  P  be  given  by  (6.16)  and  (A^,  B^,  Q)  by 

A,  =  r(A  -  SQ2 -BRllP,  +  [y-^V,„  +  D]  P)(7\  (8.8) 

B,  =  rSQC'^Vf:\  (8.9) 

Q=-Pj;P,G'^.  (8.10) 


Then  {E,  A  +  AA)  is  detectable  for  all  {AA,  AB)  e  U  //  and  only  if  A  +  AA  is  asymptotically  stable  for  all 
(AA,  AB)  e  U.  In  this  case,  the  closed-loop  transfer  function  satisfies  the  disturbance  attenuation 

constraint 

li4^-(4-)iL^Y,  (d/l,dP)eU, 


(8.11) 
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and  the  worst  case  Lj  performance  criterion  (2.7)  satisfies  the  bound 

J{A„  B„  Q)  ^  tr[(/>  +  P)V,  +  PSQIQS'^] .  (8.12) 


9.  Numerical  solution  of  the  design  equation 

One  of  the  principal  motivations  for  the  Riccati  equation  approach  is  the  opportunity  it  provides  for 
developing  efficient  computational  algorithms  for  control  design.  In  particular,  the  goal  is  to  develop 
numerical  methods  which  exploit  the  structure  of  the  Riccati  equations.  It  turns  out  however,  that  methods 
for  solving  standard  Riccati  equations  caimot  account  for  the  additional  terms  which  appear  in  the 
modified  equations  such  as  (5.6)-(5.9).  Therefore,  a  new  class  of  numerical  algorithms  has  been  developed 
based  upon  homotopic  continuation  methods.  These  methods  operate  by  first  replacing  the  original 
problem  by  a  simpler  problem  with  a  known  solution.  The  desired  solution  is  then  reached  by  integrating 
along  a  path  which  connects  the  starting  problem  to  the  original  problem.  These  ideas  have  been 
illustrated  for  the  reduced  order  problem  in  [5]  and  the  constrained  problem  in  [3]  where  the  coupling 
terms  preclude  standard  Riccati  techniques.  A  complete  description  of  the  homotopy  algorithm  will  appear 
in  [6]. 


10,  Further  extensions 

The  results  of  this  paper  can  readily  be  extended  in  several  directions: 

(1)  Mixed  bounds,  i.e.,  letting  AA  ^AAi  +AA2  and  bounding  AAi  with  the  linear  bound  and  AA^ 
with  the  quadratic  bound  (this  would  unify  the  linear  and  quadratic  bound  results). 

(2)  H2  and  H„  cross  weighting  terms  (e.g.,  x^i?i2«)  as  well  as  correlated  plant  disturbance  and  sensor 
noise. 

(3)  Nonstrictly  proper  plant  model,  i.e.,  (2.2)  replaced  by 

y{t)  =  (C  +  dC)x(r)  +  {D  +  AD)u{t)+D2w{t).  (10.1) 

(4)  Nonstrictly  proper  controller,  i.e.,  (2.4)  replaced  by 

«(r)  =  Qx,(/)  +  f?,>-(r)  (10.2) 

and  the  related  problems  of  singular  control  weighting  (R^  ^  0)  singular  measurement  noise  (F^  >  0). 

(5)  Discrete-time  and  sampled-data  design. 


11.  Conclusions 

The  Riccati  equation  approach  to  fixed-order  constrained  LQG  design  has  been  extended  to 

account  for  the  presence  of  parameter  uncertainties  in  the  state  space  plant  model.  Specifically,  by 
embedding  quadratic  Lyapunov  bounds  within  the  design  equations,  the  resulting  controllers  are  guaran¬ 
teed  to  provide  robust  stability  and  robust  Hi/H^  performance  over  a  specified  range  of  parameter 
uncertainty.  Two  distinct  bounds  were  considered,  namely,  a  linear  bound  and  a  quadratic  bound.  Among 
the  open  problems  which  remain  to  be  examined  are  the  necessity  of  the  design  equations,  the  conserva¬ 
tism  of  the  bounds,  and  the  existence  of  solutions. 
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SUMMARY 

In  controlling  distributed  parameter  systems  it  is  often  desirable  to  obtain  low-order,  finite-dimensional 
controllers  in  order  to  minimize  real-time  computational  requirements.  Standard  approaches  to  this 
problem  employ  model/controller  reduction  techniques  in  conjunction  with  LQG  theory.  In  this  paper  we 
consider  the  finite-dimensional  approximation  of  the  infinite-dimensional  Bernstein/Hyland  optimal 
projection  theory.  Our  approach  yields  fixed-finite-order  controllers  which  are  optimal  with  respect  to 
high-order,  approximating,  finite-dimensional  plant  models.  We  illustrate  the  technique  by  computing  a 
sequence  of  first-order  controllers  for  one-dimensional,  single-input/single-output  parabolic  {heat/ 
diffusion)  and  hereditary  systems  using  a  spline-based,  Ritz-Galerkin,  finite  element  approximation.  Our 
numerical  studies  indicate  convergence  of  the  feedback  gains  with  less  than  2<?o  performance  degradation 
over  full-order  LQG  controllers  for  the  parabolic  system  and  10%  degradation  for  the  hereditary  system. 

KEY  svoRDS  Finite-dimensional  compensation  Distributed  parameter  systems  Optimal  control 


1.  INTRODUCTION 

Approximation  methods  for  the  optima)  control  of  distributed  parameter  systems  have  been 
widely  studied.  In  particular,  the  approach  taken  in  References  1-12  involves  approximating 
the  original  distributed. parameter  system  by  a  sequence  of  finite-dimensional  systems  and  then 
using  finite-dimensional  control  design  techniques  to  obtain  a  sequence  of  approximating, 
siiboptimal  control  laws,  observers  or  compensators.  Furthermore,  in  these  treatments  it  was 
demonstrated  that  if  the  open-loop  system  is  approximated  appropriately,  then  it  is  possible 
to  guarantee  convergence  of  the  sequence  of  suboptimal  controllers,  observers  or  compensators 
respectively  to  the  optimal  controller,  observer  or  compensator  for  the  origi-^al  infinite¬ 
dimensional  system.  In  addition,  it  can  oc  shown  that  when  the  approximating  suboptii. 
control  laws  or  esrimarors  are  applied  to  the  origi.nal  system,  near-optimal  performance  can 
fri-quently  be  obtained.  These  ideas  have  been  pursued  in  the  context  of  both  open-  and  closed- 
loop  control,  ill  both  continuous  and  discrete  time,  and  for  both  full-state-feedback  control  and 
LQG  (i.e.  Kalman-filtcr-based)  state  estimation  and  compensation. 

In  practic.il  situations,  however,  it  is  often  of  interest  to  obtain  the  simplest  (i.e.  the  lovvest- 
prder)  controller  which  pro  .ides  a  given  de.sired  feedback  performance.  This  is  usually  achieved 
in  one  of  two  ways;  either  the  plant  appro.ximation  order  is  reduced  prior  to  controller  design 
or  reducticn  techniques  are  applied  to  a  given  high-order  control  law.  Unfortunately,  th* 
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former  approach  may  result  in  undesirable  spillover  effects  while  the  latter  may  yield  low-order 
controllers  of  low  authority  which  perform  unacceptably.  In  fact,  with  the  second  approach 
this  may  occur  even  when  a  suitable  controller  is  known  to  exist.  For  example,  as  is  shown  in 
Reference  13,  controller  reduction  techniques  may  even  destabilize  the  closed-loop  system. 

A  third,  more  direct  approach  involves  fixing  the  controller  order  a  priori  and  then 
optimizing  a  performance  criterion  over  the  class  of  fixed-order  controllers.  In  a  finite¬ 
dimensional  setting  a  set  of  necessary  conditions  in  the  form  of  four  coupled  matrix  equations 
(as  a  direct  extension  of  the  pair  of  separated  Riccati  equations  of  LQG  theory)  which 
characterize  the  optimal  fixed-order  compensator  was  derived  in  Reference  14.  These  four 
equations  are  coupled  via  an  oblique  projection  (idempotent)  matrix.  In  the  full-order  case  this 
projection  becomes  the  identity,  thus  effectively  eliminating  the  additional  two  equations,  and 
the  necessary  conditions  reduce  to  the  standard  LQG  Riccati  equations. 

The  notion  that  this  direct  (i.e.  fixed-finite-order)  approach  can  be  applied  to  distributed 
parameter  systems  was  first  suggested  by  Johnson  and  further  developed  in  References  16  and 
17.  To  realize  such  an  approach,  however,  would  require  a  suitable  generalization  of  the 
optimality  conditions  for  the  finite-dimensional  fixed-order  theory.  This  result  was 
subsequently  obtained  in  ^..ference  18,  where  the  matrix  optimal  projection  equations  obtained 
in  Reference  14  for  finite-dimensional  systems  were  extended  to  a  set  of  four  coupled  operator 
Riccati  and  Lyapunov  equations  characterizing  optimal  fixed-finite-order  controllers  for 
infinite-dimensional  systems. 

In  developing  numerical  schemes  to  actually  compute  fixed-finite-order  compensators  for 
infinite-dimensional  systems,  one  might  consider  an  approach  wherein  LQG  reduction 
procedures  aie  applied  to  a  sequence  of  controllers  obtained  by  using  firiitcrdimensional  full- 
order  design  techniques  in  conjunction  with  high-order  finite-dimensional  plant  approxi¬ 
mations.  However,  such  an  approach  is  unappealing  for  two  reasons.  First,  since  such  methods 
are  not  predicated  on  the  minimization  of  a  performance  index,  prospects  for  convergence  are 
slim.  Secondly,  controller  reduction  methods  have  not  proven  to  be  reliable  in  .producing 
stabilizing  compensators  (see  e.g.  Reference  13). 

Her.ce,  as  an  alternative,  we  develop  an  abstract  approximation  framework  (and  ultimately 
computational  schemes)  which  combines  the  infinite-dimensional  optimal  projection  theory  of 
Reference  18  with  the  approximation  ideas  developed  in  References  9~ 1 2  for  infinite¬ 
dimensional  LQG  problems.  More  precisely,  our  approach  involves  constructing  a  sequence  of 
approximating  finite-dimensional  subspaces  of  the  original,  underlying,  infinite-dimensional 
Hilbert  state  space  along  with  corresponding  sequences  of  bounded  linear  operators  which 
approximate  the  given  input,  output  and  system  operators.  Then,  by  choosing  bases  for  these 
approximating  subspaces  and  applying  the  finite-dimensional  optimal  projection  theory,  a 
sequence  of  matrix  equations  characterizing  a  sequence  of  approximating  optimal  fixed-finite- 
order  compensators  for  the  distributed  system  is  obtained.  Finally,  numerical  techniques  for 
solving  the  matrix  optimal  projection  equations  (e.g.  the  homotopic  continuation  algorithm 
described  in  References  19  and  20)  can  be  used  to  compute  the  sequence  of  approximating 
gains. 

Our  primary  aim  in  this  paper  is  to  describe  the  general  approach  we  are  proposing,  to  discuss 
its  implementation  and  to  demonstrate  its  feasibility  and  piacticality.  We  offer  no  convergence 
arguments  here  but  rather  hope  to  treat  them  in  a  more  theoretical  paper  to  follow.  Inste^'d 
we  consider  the  application  of  our  technique  to  two  examples.  One  involves  the  control  of  a 
one-dimensional,  single-input/sing  -output  parabolic  (heat/diffusion)  system  while  the  other 
involves  a  single-input/single-oulput  one-dimensional  hereditary  control  system.  These 
relatively  simple  examples  have  been  used  throughout  the  distributed  parameter  control 
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literature  to  illustrate  the  application  of  new  theories  and  techniques.  A  detailed  discussion  of 
the  application  of  our  ideas  to  more  complex  control  systems,  e.g.  the  vibration  control  of 
flexible  structures,  will  also  appear  elsewhere.  We  use  spline-based  Ritz-Galerkin  finite  element 
schemes  to  approximate  the  open-loop  systems  (one  for  which  convergence  can  be 
demonstrated  in  the  LQG  case)  and  present  and  discuss  some  of  the  numerical  results  which 
we  have  obtained  using  our  genera!  approximation  framework. 

We  now  outline  the  remainder  of  the  paper.  In  Section  2  we  briefly  review  the  infinite¬ 
dimensional  optimal  projection  theory  from  Reference  18,  describe  the  approximation 
fr^.nework  and  derive  the  corresponding  equivalent  matrix  equations  and  feedback  gains  which 
characterize  the  approximating  fixed-finite-order  compensator.  In  Section  3  we  consider  the 
examples,  construct  the  approximation  schemes  and  discuss  our  numerical  findings.  Section  4 
contains  a  summary  and  some  concluding  remarks. 

2.'  OPTIMAL  PROJECTION  THEORY  AND  FINITE-DIMENSIONAL 

APPROXIMATION 

We  consider  the  following  fixed-finite-order  dynamic  compensation  problem.  Given  the 
infinite-dimensional  control  system 

x{t)  =  Ax{t)-^Buit)  +  Hiw{t)  (1) 

with  measurements 

y{,t)  =  Cx(()  +  //zw(0  (2) 

where  te  (0,  <»),  design  a  finite-dimensional,  ricth-order  dynamic  compensator 

MO  = +  Bcy(r)  (3) 

u(f)  =  CcXc(0  (4) 

which  minimizes  the  steady-state  performance  criterion 

y(/l«.  Be,  Cc)  ^  lim  E(</?,.v(/),A:(/)>  +  «(r)'^/?2M(/)]  (5) 

/—CO 

For  convenience  we  denote  the  infinite-dimensional  plant  by  FI;  that  is, 

ni  |/1,B,C./?,,/?2,  K,,  Ki) 

Here  x(f)  lies  in  a  real,  separable  Hilbert  space  with  inner  product  <•,•>,  A: 
Dom(A)C  a  closed,  densely  defi.ied  operator  which  generates  a  Co  semigroup 

I  T(()'- 1  ^  0)  of  bounded  linear  operators  on  -i?’)  and  We  assume 

that  the  state  and  measurement  are  corrupted  by  a  white  noise  signal  w(t)  in  a  real,  separable 
Hilbert  space  (see  Reference  21  or  22),  that  Hi  Hz  6  'A IR'),  R\  ^  is 

(self-adjoint)  non-negative  definite  and  that  Ri  is  an  /r:  x  m  (symmetric)  positive  definite  matrix. 
We  define  Vx  =  H\H\  and  Vz  =  HzHz,  where  (  )*  denotes  adjoint,  and  assume  for  convenience 
that  HiH*  =  0  and  that  Vz  is  positive  definite.  In  addition  we  make  the  assumption  that  either 
the  open-loop  semigroup  ( T{t):  /  ^  0}  is  Hilbeit-Schmidt  or  the  operator  Vi  is  trace  class. 
Recall  that  a  linear  semigroup  {S(/):  /  ^  0)  is  said  to  be  Hilbert-Schmidt  if  the  operators  S{t) 
are  Hilbert-Schmidt  for  t>0.  Note  also  that  Hi  Hilbert-Schmidt  is  sufficient  for  Vi  to  be 
trace  class.  The  compensator  is  assumed  to  be  of  fixed  finite  order  tic  (i.e.  Xc(0  6  !R"‘)  and  Ac, 
Be  and  Cc  are  matrices  of  appropriate  dimension.  For  further  details  and  discussion  on  the 
problem  statement  and  the  above  assumptions,  see  Reference  18. 
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We  summarize  here  the  primary  result  from  Reference  18  characterizing  optimal  fixed-finite- 
order  controllers.  For  convenience  define  E  =  BRz'B*  and  E  =  C*1^2 'C.  Also  let  and  I./ 
denote  respectively  the  «e  X  «c  identity  matrix  and  the  identity  operator  on  -ii'. 


Theorem  I 

Let  He  be  given  and  suppose  there  e.xists  a  controllable  and  observable  Heth-order  dynamic 
compensator  (Ac,  .5c,  Cc)  which  minimizes  J  given  by  (5)  and  for  which  the  closed-loop 
semigroup  generated  by 

is  uniformly  exponentially  stable.  Then  there  exist  non-negative  definite  operators  Q,  P,  Q,  P 
on  '-‘y  such  that  Ac,  Be  and  Cc  are  given  by 

Ac  =  r(A-QE-EP)C*  (7) 

Bc  =  rQC*Vl'  (8) 

Cc=  -Rz^B^PG*  (9) 

where  ( .v{/):  /  ^  0)  is  the  closed-loop  semigroup  on  .i/‘x  1R"‘  generated  by  the  operator  .-/ 
given  by  (6), 

rank  Q  =  rank  P  =  rank  QP  =  Hc 

(10) 

QP=G*Mr,  rG*=/„,  (11) 

for  some  A/€  (R"' 

0=  AQ  +  QA*+ 1^1 -gEQ  +  T.OEQr!  (12) 

0=  A*P+  PA  +  Ri-  PZP+TlP'^PTi.  (13) 

0  =  ( A  -  E P)S  +  0( A  -  E  5)*  +  QEO  -  7^  QEQrt  (14) 

0  =  (A  -  Qt)*P+P{A  -  OE)  +PZP-7I  PZPr^  (15) 

where 

Furthermore,,  the  resulting  optimal  closed-loop  cost  is  given  by 


y(Ac,  5c,  Cc)  =  tr  (  .7  (/)  y  .'/-*(/).>? 

Jo 


where  |  •/(/):  /  ^  0)  is  the  closed-loop  semigroup  on  .y  x  .'R"  generated  by  the  operator  ■■/ 
given  by  (6) 


'=[:■ 

0 

5cK257 

A  r 

0 

CjRzCc^ 

It  is  shosvn  in  Reference  18  that  t'  lactorizatidn  (11)  for  the  non-negative  definite  operators 
Q  and  P  satisfying  rank  QP-  iways  e.xists  and  is  unique  except  for  a  change  of  basis  in 
•R"  .  .Also  shown  is  that  G*:  R"‘  Dom(A)  so  that  the  expression  (7)  is  well-defined. 
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Equations  (12)-(15)  are,  in  general,  infinite-dimensional  operator  equations.  To  actually  use 
them  to  compute  the  optimal  fixed-order  compensator,  a  finite-dimensional  plant 
approximation  is  required.  For  each  A'^=  1,2, ...  let  denote  a  finite-dimensional  subspace 
of  .a:  and  let  ^ -*  denote  the  corresponding  orthogonal  projection  of  .ii’onto 
Let  {St''' )  and  V^' ^SSiSt").  We 

consider  the  system  (7)-(15)  with  the  plant  11  replaced  by  the  plant  11^  given  by 

4  ( /I ^  B",  C",  R'^,  /?2,  V^',  Vi  1 

Typically,  the  operators  B''' ,  C" ,  R'l'  and  Kl''  are  chosen  as  B‘''  =  .'f''B,  C'' =  C.'t''', 
R'^  =  .iP^Ri  and  vC  =  .iP^Vi  with  the  requirement  that  converge  strongly  to  the  identity 
I.i  as  N'-*  oo.  The  operator  A"  is  chosen  so  that  it  and  its  adjoint  satisfy  the  hypotheses 
of  the  Trotter-Kato  semigroup  approximation  theorem  (i.e.  stability  and  consistency;  see 
e.g.  Reference  23).  That  is,  A'^  is  chosen  so  \at  Iim,v-oor^(/)>i^‘'^<^  =  r(/)0  and 
lim,v-<a  T''{t)*.iP‘''4>  =  T{t)*4>  uniformly  in  t  for  t  in  bounded  intervals  for  each 
where  T'^U)  =  exp(M^),  r  ^  0.  We  shall  say  more  about  these  choices  for  A",  C",  R\ 

and  Vi  when  we  make  some  remarks  concerning  convergence  questions  below. 

Although  with  the  plant  11^  equations  (12)-(15)  are  finite-dimensional,  they  are  still  operator 
equations.  It  is  their  matrix  equivalents  which  are  used  in  computations.  Unless  orthonormal 
bases  are  chosen  for  the  subspaces  St"  (which  is  typically  not  the  case  in  practice),  some  care 
must  be  taken  to  obtain  the  appropriate  matrix  system. 

For  each  N-  1,2,...  let  |0/l/=i  be  a  basis  for  St"  and  choose  the  standard  bases  for 
all  Euclidean  spaces.  For  a  linear  operator  L  with  domain  and  range  St"  or  any  Euclidean 
space,  let  [L]  denote  its  matrix  representation  with  respect  to  the  bases  chosen  above.  Also, 
let  denote  the  Ar^-square  Gram  matrix  corresponding  to  the  basis  (^/lyCi;  that  is, 
^!)=  ij  =  l,2,...,k".  Noting  that 

((/l  '')*I  =($■'')- '[/l'^]‘r<l>'\  ((5*'')*)  =  ((C'")]  =(^-''')-'[C‘'']^  . 

[(T‘I)*1  =(4>-'')-'[rr]^<f.'''',  [^"]  =  [B"]R2^[B"]'^<^", 

(S-'']  =(<t-'')-'(C''')^K2-'[C'') 

the  matrix  equivalents  of  the  operator  equations  (11)-(14)  become 


+  [r^]  [Q*'']  (£■'')  (Q-'']  -{^")-'{T'l]''i" 

0  =  (<!>•'')-'[ /I ^  jp.vj  _  +  ipjVj  _  [P‘''](i:-''][p-V] 


0  =  ((/l'^I  -  -I-  [e''')(‘^'")-' ([/!•'']  -  (E'^'] 

+  [Q"]  (£'’^1  [Q"]  -  (r-r  1  [Q-"']  It"]  [Q"]  {^"r'  -  [rl  ] 

0  =  (<l.-'^)-‘ ((/!■'')  -  (Q'''](f-'^])T<f>‘'’{P-'')  +  [A'^Jd'/l-''']  -  (<2"][E-'']) 
+  [P-'^j  [E-'']  (P'"‘]  -(<I>‘'^)-'[7‘1’)''4>-''[P‘''')  [E-'^]  [P-'^J  [t!) 


(17) 

(18) 

(19) 

(20) 


Therefore,  if  we  define  the  k"xk''  non-negative  definite  matrices 


Qd''^  (Q-''](‘1>‘V, 

V6''^  [Fi'^](‘I>''')-‘, 
Eti'i  (a-''jP2''[P''V 


<{,.V(p.V] 

Po'"’^ 

R^^  <1>"[R{'] 


V  A 
wO  = 


[C''VK: '(C-'  l 
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we  can  solve  the  matrix  optimal  projection  equations  given  in  Reference  14  corresponding  to 
the  matrix  plant  model 

I  [5^].  [C^],R6\R2,  Vi] 


to  obtain  the  matrices  Qo,  Po,  and  Po.  The  approximating  optimal  Wcth-order  dynamic 
compensator  is  then  given  by 

>1^'=  ro^(/l'^]  -  Gats' -i:S'PS')(G$'f 

CS'=  -RI^B'^l^PS'iGS'y 
where  Fo^,  Go^€  (R"‘  ^  *'"  and  IR"'  satisfy 


qS'pS' = gS'm^tS'  rS'iGS'  f  =  r„, 

[r^]  =  (Go^'j^Fo^  [t^ ]  =  /*■'' -  [r""] 

When  an  infinite-dimensional  controller  will  suffice,  Cc=  -/?2 IR'”)  and 
jBc  =  (2G*F2  ‘  €•2’((R^  are  the  usual  infinite-dimensional  LQG  controller  and  observer 
gains.  ’  The  operators  P,Q^Se{St')  are  the  non-negative  definite  solutions  to  the  two  decoupled 
operator  algebraic  Riccati  equations  (12)  and  (13)  with  r  and  tx  formally  set  to  /.y  and  0 
respectively.  Since  Cc  has  range  in  IR”  and  Be  has  domain  IR',  there  exist  vectors 
Ce  =  (Cc‘,...,ci")^6  x”»i  ^Fand  bc-ibly...,b'c)^  ^  xj.i  ^  such  that 

[CeA:l/=<4,x>,  1=1,2,  ...,m  xiSC 

I 

Bcy  =  bJy=J!,yM,  y  =  iyu-‘,yi)i^' 

i>i 

The  vectors  Cc  and  b^  are  referred  to  as  the  optimal  LQG  functional  controller  and  observer 
gains  respectively. 

With  regard  to  approximation  for  the  full  order  LQG  problem,  for  each  N=  1,2, ...  we  take 
Uc  =  Then  it  is  not  difficult  to  show  that 


Q'' [  P'V]  =  (.OS',  X),  x^:r 

B?y=(bS'fy,  j'EiR' 

where  x  "Li  and  b^ ^  x  ti"''  are  ^iven  by  Cc  =  C^'(4>'‘^)"'i^''^  and  be'  =  (BS)^(f>‘'' 
respectively  with  0''  =  (<^r',  ...,0*')e  x/,V3?’‘\  The  vectors  and  bi"  are 

referred  to  as  the  approximating  optimal  LQG  functional  controller  and  observer  gains 
respectively.  To  compute  them  we  need  only  solve  two  standard  decoupled  matrix  algebraic 
Riccati  equations  for  the  k'^  x  k'''  non-negative  definite  matrices  Qo  and  Po. 

A  rather  complete  convergence  theory  for  LQG  approximation  can  be  found  in  Reference 
9.  Essentially,  it  is  shown  there  tha.‘  if  the  approximating  subspaces  are  chosen  so  that  the 
projections  converge  strongly  to  the  identity  as  W-*  oo,  the  operators  A'^,  B'^,  and 

are  chosen  as  was  described  above  and  the  operators  and  are  uniformly  bounded 

in  N,  then  and  P^  converge  weakly  to  Q  and  P  respectively  as  oo.  This  in  turn  implies 

that  Ce  Cc  strongly,  bS'  -*  Be  weakly,  cS'  -*  Cc  and  bS'  -*  be  weakly  and  the  closed-loop 
semigroup  for  the  approximating  optimal  LQG  compensator  converges  weakly  to  the  closed- 
loop  semigroup  for  the  optimal  infinite-dimensional  LQG  compensator  as  W-*oo.  If,  in 
addition,  the  operators  S'^(0  =  T‘''{t)  B'^CS'  and  S'^{t)  =  T‘''{t)  -  BS'C'^  are  uniformly 
exponentially  stable,  uniformly  in  N,  then  -*Q  and  P''’’  -♦  P  strongly,  Cc  Ce  and 
Be  -*  Be  in  norm,  Ce  -*  Cc  and  b"  -*  be  strongly  and  the  closed-loop  semigroups  converge 
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Strongly  as  N-*  «,  If  and  V\'  are  coercive,  uniformly  in  N,  then  S^(0  and  S^(t)  will  be 
uniformly  exponentially  stable.  If  it  is  also  true  that  Ri  and  Vi  are  trace  class  and  Ri'^^-*  Ri 
and  V\  -*  Viin  trace  norm,  then  Q  and  P  are  trace  class  and  Q  and  -*  p 

in  trace  norm  as  N-*  oo.  The  development  of  a  complete  convergence  theory  for  the 
approximating  fixed-order  d.;signs  appears  to  be  a  much  more  difficult  question.  One  would 
expect,  however,  that  any  such  theory  would  require  at  least  minimally  that  the  sufficient 
conditions  for  convergence  of  the  approximating  LQG  designs  be  satisfied. 

Returning  to  the  fixed-finite-order  case  we  note  that  in  general  the  approximating  optimal 
projection  equations  may  not  possess  a  unique  solution.  However,  Richter"®  shows  for  the 
finite-dimensional  case  that  it  is  possible  to  obtain  an  upper  bound  for  the  number  of  stabilizing 
solutions.  He  uses  topological  degree  theory  to  obtain  the  following  result. 


Theorem  2 

Consider  equations  (12)-(15)  with  the  infinite-dimensional  plant  n  replaced  by  the  finite- 
dimensional  plant  n^.  Let  rtu  denote  the  dimension  of  the  unstable  subspace  of  /I and  assume 
that  rtc  ^  rtu.  Then  in  the  class  of  non-negative  definite  operators  Q^,  P^,  Q^,  P^  on 
satisfying  rank  ^^  =  rank  P'^  =  rank  =  nc  there  exist  at  most 

C^,m,l)-  nu\  ^  ■  nN  n 
ric-ria  ) 

1,  otherwise 

solutions  of  (12)-(15),  each  of  which  is  stabilizing.  If,  in  addition,  the  plant  C^)  is 

stabilizable  by  an  Wcth-order  controller,  then  there  exists  at  least  one  stabilizing  solution  of 
(10H15). 

Theorem  2  shows  that  while  there  may  e,xist  multiple  solutions  to  the  finite-dimensional 
optimal  projection  equations,  in  practice  this  number  can  be  quite  small.  For  example,  if 
/?c  ^  /lu  and  the  system  is  either  single-input  {m  =  1)  or  single-output  (/  =  1),  then  there  exists 
at  most  one  solution  to  (10)-(15)  for  the  plant  n'\  Moreover,  the  number  of  solutions  of  the 
approximating  optimal  projection  equations  remains  bounded  in  N,  since  for  N  sufficiently 
large,  min(A:"^, /«,/)  =  min(m, /).  The  e,xistence  of  at  least  one  stabilizing  solution  of  course 
depends  upon  whether  or  not  the  plant  is  stabilizable  by  an  /7cth-order  controller  (for  relevant 
results,  see  Reference  24).  Finally,  while  it  may  be  possible  to  stabilize  a  plant  with  Wc  <  «u, 
this  case  lies  outside  the  scope  of  the  analysis  given  in  Reference  19. 


3.  EXAMPLES  AND  NUMERICAL  RESULTS 

We  first  consider  the  one-dimensional,  single-input/single-output  parabolic  (heat/diffusion) 
control  system  with  D'richlet  boundary  conditions  given  by 


(/,  j;)  =  a  (/,  ?;)  -I-  b{yi)u(t)  +  hi  {rf)wi  (I,  t]). 


0  <  7J  <  1  , 


r>0 


(21) 


i'(r,0)  =  0,  i;(M)  =  0,  t>0 

3'(0=  [  c(,Jt)vit,ri)  dij  +  hzWiit),  i>0 
Jo 


(32) 


(23) 
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where  a  >  0,  and  b{-)  and  c(*)  are  given  by 

(.0,  elsewhere 

0/(72-71),  yi^rj^yi 

[0,  elsewhere 

with  0  </3i  </32  ^  1  and  0  <  71  <  72  ^  1.  In  (21)  and  (23),  /»(•)  6  Z,oo(0, 1),  wi(r,  •)€  LziO,  1), 
almost  all  /€  [0,  <»)  (see  Reference  23,  p.  314),  hi  is  a  non-zero  constant  and  ^2(0  is  unit- 
intensity  white  noise. 

To  jrewrite  (21)-(23)  in  the  form  (1),  (2),  in  the  usual  way  we  take  =  LiiO,  1)  endowed  with 
the  standard  Li  inner  product,  let  ,v(/)  =  i;(/,  •),  I'^O,  define  A:  Dom(/l)  C  4#' by 
A(f>  =  aD^<f>  for  06  Dom/1  =  H^iQ,  l)r\Ho(0, 1)  and  define  fi6i?(IR',  3t')  and 
by  Bu  =  b(‘)u  for  m  6  (R‘  and  C0  =  Jo  c(ij)0(i?)  di;  for  0  6  Z.2(0, 1)  respectively.  Furthermore, 
let  ^  =  Z,2(0, 1)  X  (R,  set  w(c)  =  '),  wi{t))  i  and  define  and 

//2  6^(£r,  IR‘)  by  Hiz  =  hi(-)zi  and  H2Z  =  hizi  for  z  =  (zi,Z2)6  respectively. 

It  is  well  known  (see  e.g.  Reference  23)  that  A  is  closed,  densely  defined  and  negative  definite. 
Furthermore,  A  is  the  infinitesimal  generator  of  a  uniformly  exponentially  stable,  analytic 
(abstract  parabolic)  Hilbert-Schmidt  semigroup  |  r(r):  /  ^  0 )  of  bounded,  self-adjoint  linear 
operators  on  -T. 

We  consider  a  linear  spline-based  Ritz-Galerkin  approximation  for  the  open-loop  system. 
For  each  iV=2,3,...  let  {0/)j=l'  be  the  linear  spline  (‘hat’)  functions  defined  on  the 
interval  [0, 1)  with  respect  to  the  uniform  partition  |0, 1//V,2/Af, ...,  1),  i.e. 


(  Nr,-j+l, 
J+l-Nrj, 

(0, 


»?€[(/- D/A/J/iV) 
>76  [y7/v,(y+i)/A/) 
elsewhere  on  [0, 1) 


y  =  1,2, ...,  A/- 1.  Set  =  span(0/)j=l'  and  note  that  /r'' =  dim  =  N- I  and 
■if"'’  C  //o(0, 1)  for  all  N.  If  -if '  ■if"''  denotes  the  orthogonal  projection  of  onto  ■i^"'', 

then  standard  convergence  estimates  for  interpolatory  splines^*  can  be  used  to  show  that 
lim,v-«  .^”'^0  =  0  in  Lz(0, 1)  for  06  LzfO,  1). 

There  are  two  equivalent  ways  to  obtain  an  operator  representation  for  the  usual 
Ritz-Galerkin  approximation  to  A.  First,  A  can  be  extended  to  a  bounded  linear  operator 
from  //o(0, 1)  onto  its  dual,  1),  via 

(/10)(0)= -fl<£>0.D0>,  0,06A/i(O,l)  (24) 

Since  .'r^  C  //o(0, 1)  for  all  A/=2,3,...,  we  define  /1‘''’6  by  /4  '''0'’'=  y4o'’,6''6  .i>'\ 

with  1)  considered  to  be  linear  functional  on  ■if  '''.  From  the  Riesz  representation 

theorem  we  obtain  /l‘''0''=  where  0  is  that  element  in  which  satisfies  (A  '’’6  '‘)ix''') 

=  -a<Z)0\Z3x‘''>  =  <0'\x-''>. 

Alternatively  and  equivalently,  by  using  the  fact  that  A  is  self-adjoint,  we  can  define  A  as 
follows.  Let  ./T:  denote  the  orthogonal  projection  of  the  Hilbert  space 

Ho{0, 1)  onto  Using  the  definition  (24)  it  is  not  difficult  to  show  that 

-A^S’fHoiO,  l),//“‘(0, 1))  is  coercive  and  therefore  that  A~':  //"‘(0, 1)-*  //o(0, 1)  exists 
and  is  bounded.  We  then  define  A  to  be  the  inverse  of  the  operator  given  by 

(A''’)''  =  .'/’i'A~'\.r''. 

Using  either  definition  it  is  easily  argued  that  /I  is  well-defined,  self-adjoint  and  is  the 
infinitesimal  generator  of  a  uniformly  exponentially  stable  (uniformly  in  ,V)  semigroup. 
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T'^U)  =  exp(r/l  '''),  r  ^  0,  of  bounded  linear  operators  on  Also,  using  the  approximation 
properties  of  splines  it  is  not  difficult  to  show  that  0  6;^: 

Consequently,  the  hypotheses  of  the  Trotter-Kato  theorem  are  satisfied  and  we  have 
lim,v-«  =  T{t)(t)  and  lim/v-co  6  &\  uniformly  in  t  for  t  in 

bounded  intervals.  A  detailed  discussion  of  the  results  just  outlined  can  be  found  in  Reference 

8. 

We  define  B‘''=  and  from  which  it  immediately  follows  that  limAr-oo 

=  B  and  lim/v-oD  =  C  in  norm  and  similarly  for  their  adjoints.  For  the  example  we  shall 
consider  here,  we  have  chosen  Ri  =  r\I.r  and  Ri  =  rilm,  with  ri,r2  >  0.  Setting  hi{r])  =  vV^, 
0  <  t;  <  1,  and  hi  =  vi^,  with  Ui,  vi  >  0,  we  obtain  Vi  =  Vil.r  and  Vz  =  vz.  We  then  take 
R\=.iP^R\  and  Vi  =  For  the  LQG  problem  the  open-loop  uniform  exponential 

stability  of  both  the  infinite-dimensional  system  and  the  approximating  systems  is  sufficient  to 
conclude  the  strong  convergence  of  the  approximating  Riccati  operators  to  the  unique  solutions 
of  the  infinite-dimensional  Riccati  equations,  the  uniform  norm  convergence  of  the 
approximating  controller  and  observer  gains  and  the  strong  convergence  of  the  functional  gains 
as  N-*  00. 

Since  the  basis  elements  are  piecewise  linear  with  respect  to  the  uniform  mesh 

|0, 1//V,2//V, ...,  1 1  on  [0, 1],  the  equivalent  matrix  representations  for  the  operators  defined 
above  can  be  computed  directly  and  in  closed  form.  The  Gram  matrix  ^o  = 
i,J=  1,2, ...,  N-  I,  is  given  by  (l/Af)Tridiag(g,|,5l,  and  if  we  define  the  generalized  stiff¬ 
ness  matrix  '{'“'^by  -  <7<D0/\£>0/>,  /,/=  1,2, ...,  N-l,  then  ffyVTridiagl  1,  -2, 1 ). 

It  follows  that  (/4''']  =  and  [C'^]  =c^,  with  bl^  =  = 

[  1/(B2  -/3i)]  dr,  and  =  <c, =  1 1/(72 - 7i)l  J?r  4>f{ri)  dr,,  /  =  1,2, ...,  N-  1, 

and  that  Ro  =  n^‘'^  and  =  vi  ‘. 

For  our  numerical  study  we  set  fl=  l,/?i  =  0’75 -0'03.j2,  /Sz  =  0*75 +  0-04^2, 
71  =  0*25  -  0*04^'2,72  =  0-25  -I-  0‘03,,2,  n  =  Vi  =  1,  f2  =  V2  =  lO""*  and  hi{r,)  s  1,  and  used  our 
technique  to  compute  approximating  optimal  LQG  (i.e.  ttc  =  N  -  1)  and  first-order  (i.e.  nc  =  1) 
compensators  for  various  values  of  N.  The  open-loop  stability  of  system  (21)-(23)  and  the 
approximating  systems  implies  that  the  finite-dimensional  approximating  optimal  projection 
equations  have  a  solution.  Theorem  2,  on  the  other  hand,  with  =  0  and  n^  =  I  or  nc  =  N -  I, 
implies  that  they  have  at  most  one  solution.  Consequently,  the  system  of  equations  (12)-(15) 
with  the  plants  admits  a  unique  solution. 

The  optimal  projection  equations  (12)-(15)  were  solved  by  using  the  homotopic  continuation 
algorithm  described  in  Reference  19.  There  it  is  shown  that  the  operation  count  for  the 
algorithm  is  proportional  to  p{2n^ +  {m  +  l)n^ +  {m  +  l^nc),  where  p  is  the  number  of 
integration  steps  and  n  is  the  dimension  of  the  finite-dimensional  plant.  This  count  is 
competitive  with  the  operation  count  for  the  Hamiltonian  solution  of  the  standard  Riccati 
equations,  which  is  0(16n^)  for  LQG.  Also,  note  that  the  computational  burden  for  the 
solution  of  the  optimal  projection  equations  decreases  with  n^. 

Since  /n  =  /  =  1  in  the  LQG  case,  the  optimal  functional  observer  and  feedback  control  gains 
b^  and  and  the  approximating  gains  b^'  and  are  all  simply  Lz  functions  with  bi^  and 
elements  in  We  plot  the  functions  be  and  we  obtained  for  various  values  of  N  in 
Figures  1  and  2  respectively.  The  apparent  symmetry  of  the  plots  given  in  Figures  1  and  2  is 
a  result  of  the  nearly  symmetric  placement  of  the  sensor  and  actuator  (i.e.  the  choice  of 
Bi,B2,7i  and  72)  in  this  particular  e.xample.  That  convergence  is  indeed  achieved  can 
immediately  be  observed  in  the  figures.  In  ihe  fi.xcd-order  case  with  /a  =  1,  the  compensator 
gains  .4c,  Bt  and  Cc  are  all  scalars.  Also,  for  a  first-order  controller  there  are  only  two 
independent  parameters,  and  BcQ.  In  Table  I  we  give  the  values  wc  obtained  for  .1'  and 
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Figure  1.  Parabolic  system  approximating  optimal  LQG  functional  observer  gains,  .Vs  4, 8, 12. 16,20,24,28,32 


for  various  values  of  N.  Once  again  it  is  clear  that  the  gains  are  converging  as  N 
increases.  In  addition,  in  Table  1  we  provide  the  closed-loop  costs  Jiqc  and  J'fo  computed  via 
formula  (16)  for  the  LQG  and  first-order  controllers.  These  closed-loop  costs  are  evaluated 
using  a  64th-order  modal  approximation  to  the  infinite-dimensional  system.  For  all  values  of 
.V  the  performance  of  the  fi,xed-order  compensator  was  within  2%  of  the  corresponding  LQG 
controller.  Thus,  for  example,  the  replacement  of  an  approximating  optima!  LQG  controller 
of  any  desired  order  by  an  approximating  optimal  first-order  controller  can  yield  considerable 
implementation  simplification  with  only  minor  performance  degradation.  Note  that  for  the 
example  we  consider  here  it  is  possible  to  compute  the  open-loop  cost  for  the  infinite¬ 
dimensional  system  in  closed  form.  We  have 

^L  =  tr  [  ViT*(t)RiT(l)  dl  =  Viri  IT  \  T{1)' dt 
Jo  Jo 


=  Viri  fl  f  cxp{-2n^--al)  dl  =  -p^  -K 

rjal  Jo  ^  I  r? 


v\r\ 

\2a 


■jL  =  0.08333 


REGULATOR  FUNCTIONAL  GAIN  (xlO 


DISTRIBUTED  PARAMETER  SYSTEM  COMPENSATION 


Table  I.  Parabolic  system  approximating  optimal  first-order 
compensator  gains 


N 

A:y 

•/'log 

■fro 

4 

-687-6 

5470 

0-06999 

0-07014 

8 

-720-9 

523! 

0-06870 

0-06993 

12 

-730-9 

5182 

0-06872 

0-06991 

16 

-734-3 

5145 

0-06874 

0-06990 

20 

-738-0 

5127 

0-06875 

0-06990 

24 

-737-6 

5108 

0-06876 

0-06990 

28 

-739-8 

5109 

0-06876 

0-06990 

32 

-738-7 

5099 

0-06877 

0-06990 

Finally,  for  comparison  purposes,  we  tried  applying  balancing  techniques,  to  the  LQG 
controllers  to  reduce  their  order.  However,  with  nc=  1,  such  controllers  were  found  to  be 
destabilizing.  On  the  basis  of  the  results  in  Reference  13,  this  v.-as  not  une.xpected.  Furtherniore, 
a  first-order  controller  based  upon  a  truncated  model  consisting  of  the,  first  mode  only  was 
found  to  yield  an  unstable  closed-loop  system  for  the  64th-order  truth  model. 
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As  a  second  example  we  consider  the  one-dimensional,  single-input/single-output  hereditary 
control  system  given  by 

v{ji)  =  aav{t)  + aiv{t- p)-^boU{t)-¥  h\w{t),  t>Q  (25) 

y{t)  =  coi;(/)  +  hzw{t),  /  >  0  (26) 

where  ^o.  fli.6o,co,Ai./(2,p€  IR‘  with  p  >  0,  /t2?^0,  and  vv  is  a  unit-intensity  white  noise 
process.  To  rewrite  (25),  (26)  in  the  form  (1),  (2),  we  take  .^^*=11?’  x  U{-p,0)  endowed  with 
the  usual  product  space  inner  product,  <(j;,<A),  (f,  |A)>  =’?? +  j-o  ^'1',  and  let  xU)  =  (v(i),v,), 
r^O,  where  for  r^O,  U/Elaj-P.O)  is  given  by  t;,(6)  =  u(r +  6), -p  ^  ^  0.  Define  A\ 
DomiA)  C  fit'-* by  A$  =  {ao<l>(0)  + ai(i>{-p),D(i>)  for  (^  =  (0(O),0)6Dom(/l) 

=  { ({. '!')  €  4/^H\-p,  0),  ^(0)  =  $ )  and  let  B  E  ‘,  -if)  and  C6  IR  * )  be  given  by 
Bu  =  (bou,0)  and  C(i},4))  =  cor]  respectively.  Let  .i?‘  =  IR'  and  define  Hi  €  id  (.if',  -'J')  and 
Hz  €  IR ' )  by  Hiz  =  (fitz,  0)  and  Hzz  ~  hzZ  respectively  for  c  6  !R  ‘. 

The  operator  A  is  densely  defined  and  is  the  infinitesimal  generator  of  a  Co  semigroup  |  T(t): 

/  ^  0)  of  bounded  linear  operators  on  -T  with  T(t)(rj,<j>)  =  (u(t;  r},<p),  v,(r],<j))),  t  ^  0,  where 
i;(- ;  i/i  0 )  is  the  unique  solution  to  (25)  with  bo  =  hi  =  0  and  initial  conditions  u(0)  =  r},  vo  =  4>. 
We  take  Rie£(.^‘)  and  to  be  Ri(v,<l>)  =  iriri,0)  and  Rzu  =  rzu  respectively  with 

ri,rz  >  0.  The  definitions  of  Hi  and  Hz  given  above  imply  that  Vi  and  kj  €  i^flR')  are 

given  by  1^1(77,0)  =  (A ii;,0)  and  VzZ  =  hzZ  respectively  for  (77,«^)6  .4‘and  zEiR'.  Although  in 
this  example  the  open-loop  semigroup  { T(t):  t^O]  is  not  compact,  the  operator  Ht  is  of  finite 
rank  and  therefore  Hilbert-Schmidt.  The  operator  K,  is  thus  trace  class. 

We  employ  an  appropriate  scheme  recently  proposed  by  Ito  and  Kappel.^*  We  briefly  outline 
it  here;  a  more  detailed  discussion  can  be  found  in  Reference. 26.  For  each  1,2, ...  let 
Lz(-p,0)  denote  the  characteristic  function  for  the  interval[ -yp/A/, -(y -  l)p/yV), 
y  =  1, 2 . H,  and  let  be  the  (N  +  l)-dimensional  subspace  of  .;f'  defined  by 

.y'’'  =  spanf  (1, 0),  (0,  xi'^),  •••,  (0,  xiv)  1 

Let -if'-*  denote  the  orthogonal  projection  of  .i^’onto  ■if''.  Let  (p/ly’^o  denote  the 
linear  5-spline  functions  defined  on  the  interval  (-p.O)  with  respect  to  the  uniform  mesh 
(-P,...,  -p/A',0i  and  set  =  span  {(.^/(O),^/ ))/=.).  Then  is  an  (/V4-  l)-dimensional 

subspace  of  Dom(>4)  and  is  not  difficult  to  demonstrate  that  the  restriction  of  to  is 
a  bijection  into  Using  the  fact  that  A  restricted  to  ■if'i''  has  range  in  .if''"',  we  define 
A''“'€  'y'(.jf"'^)  by  /!■'’=  /!(-'/  '')"'  and  set  T'''(0  =  exp(/l t  ^  0.  Noting  that  5(5)  C  ■y'', 
we  take  B^ ^  '/'(^^,  ■'y'')  to  be  given  by  5’'  =  5.  Similarly,  we  take  5i'^’  =  5i  and  l^i'’=  Ki.  We 
setC''  =  C. 

It  is  shown  in  Reference  26  that  •-/ '(57,6) -» (7,6),  r'(f).'/''(»7,p)  —  r(i)(>7,6)  and 
T''(i)*.A  '"{ri,4>)  -*  T(i)*(ri,<i>)  for  (77, 6) E  •5'' as  ;V— co,  uniformly  in  i,  for  i  in  bounded 
subsets  of  (0, 00).  It  then  follows  that  lim.\  -  »  B'"  =  B  and  lim \  -  x  C^.a  ''  =  C  in  norm. 

For  the  LQG  (full-order)  problem  the  optimal  functional  observer  and  feedback  control 
gains  b^  and  Cc  are  of  the  form  5c  =  (5o..0i )  and  c,-  =  (70, 71 )  respectively  with  5n,  70  6  k  '  and 
5i . 71  €  Z.2( - p, 0).  The  approximating  gains  are  of  the  form  be  =  ( Bo.Bi" )  and  q'  =  (yo  , 7' ) 
with  /3o’,7o^6  !R‘  and  5i\7i''€span|x/''  jy-i-  Since  vve  are  treating  a  one-dimensional  e.xample, 
if  bo  ^  0,  the  theory  in  Reference  26  implies  that  Zo  -*  0o  and  -♦  70  in  5 '  and  that  d'  -*  )3i 
and  7i'’'“*7i  in  Lz(~P,0)  as  ;V-*co. 

Once  again,  as  in  the  first  example,  matrix  representations  for  the  operators  .-1 5  C',  5' 

and  kV  arc  not  difficult  to  compute  in  do.scd  form.  Indeed,  the  (.V-r  l)x(,V-f  1)  matrix 
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representation  for  the  bijection  .y’*'':  -ifi  is  given  by 


Then  [/4‘'^]  =  where 


[K‘^]  = 


Co  0 

NIp  -NIp 
0  NIp 


0 

-NIp  0 


0  NIp  -NIp  0 
0  NIp  -  NIp_ 


We  have  the  (/V+  1)  x  1  matrix  (S*'']  =  (Z>o  0...0]^  and  the  I  x(A/4- 1)  matrix  = 
(Oj  0...0],  while  =ri[.jr'^]  and  =h}[.JC'']  where  the  {N+  l)x{N-r  1)  matrix 
is  given  by 


We  set  co=  Cl  =  ^io  =  Co  =  /'i  =/j|  =p=  I,  r2  =  6-l  and  /i2'=^(0'l)  and  computed 
approximating  optimal  LQG  (i.e.  /;«  =  Af+l)  and  first-order  (i.e,  /7c=  1)  compensators  for 
N  =  8, 16, 24  and  32.  The  optimal  LQG  observer  gains  are  given  in  Table  3  and  Figure  3;  the 
control  gains  are  given  in  Table  4  and  Figure  4.  The  symmetry  in  the  observer  and  control  gains 


Table  II.  Hereditary 
system  open-loop  poles 


I  -278465 
-I -588317 
-2-417631 
-2-861502 
-3-167754 
-3-401945 
-3-591627 
-3 -75 1047 
-3-888543 
-4-009422 
-4-117267 
-4-214618 


±4-155305i 
±  10-68603i 
±  I7-056IIi 
±23-38558i 
±  29-69798i 
±  36-001461 
±42-29965i 
±  48-59442i 
±54-88636i 
±61-17761! 
±  67-46710i 


Tabic  III.  Hereditary  system  approximating  optimal  LQG 
scalar  observer  gains 


4-4213 


4-4229 


4-4233 


4-4234 


OQSERVER  FUNCTIQNAl.  GAIN  (N>8) 


REGULATOR  FUUCTIOHAL  GAIH  (N=16) 


I 

I 


OELAY  COORDINATE 

-t.o  -a. a  -o.t  -0.7  -a.«  -o.c  -0.4  -o.*  -o.a  -o.t  o.o 


ri!iiiro4.  Hereciiiary  sysicm  iipiiruNimaiiiit:  opiiinal  LQG  Tiiiicdoiial  conirol  !5ain>:  ,S,  16.24. 32 


REGULATOR  FUHCTIOHAL  GAIN  (H=32)  REGULATOR  FUHCTIOiJAL  GAIN  (N=24) 
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Table  IV.  Hereditary  system  approximating  optimal  LQG  scalar 
control  gains 


N 

8 

16 

24 

32 

yo 

-4-4213 

-4-4229 

-4-4233 

-4-4234 

Table  V.  Hereditary  system  approximating  optimal  first-order 
compensator  gains 


N 

J'lqg 

J?o 

8 

-4-835 

- 16-057 

1 -4042 

1-5221 

16 

-4-936 

-16-343 

J -403877 

1-5298 

24 

-4-959 

-16-378 

1-403856 

1-5309 

32 

-4-962 

- 16-404 

1-403852 

1-3317 

is  due  to  the  nature  of  the  input  and  output  we  have  chosen  and  the  usual  duality  which  exists 
between  the  optimal  regulator  and  filtering  problems.  The  first  23  open-loop  poles  of  the 
system”  are  given  in  Table  2.  The  approximating  first-order  compensator  gains  along  with  the 
corresponding  and  LQG  closed-loop  costs  are  given  in  Table  5.  These  costs  were  computed 
using  an  evaluation  model  obtained  by  setting  N  =  64.  Note  that  the  performance  of  the  first- 
order  controllers  is  within  10%  of  the  performance  of  the  LQG  controllers.  Once  again,  on  the 
basis  of  the  numerical  results  presented  here,  it  appears  that  .the  approximating  fixed-order 
compensator  gains  are  converging  as  fV-*  oo. 

4.  SUMMARY  AND  CONCLUDING  REMARKS 

We  have  proposed  an  approximation  technique  for  computing  optimal  fi.xed-order  compen¬ 
sators  for  distributed  parameter  systems.  Our  approach  involves  using  the  optimal  projection 
theory  for  infinite-dimensions!  systems  (which  characterizes  the  optimal  fixed-order 
compensator)  developed  in  Reference  18  in  conjunction  with  finite-dimensional  approximation 
of  the  infinite-dimensional  plant.  We  demonstrated  the  feasibility  of  our  approach  with  two 
examples  wherein  we  used  spline-based  Ritz-Galerkih  finite  element  schemes  to  compute 
approximating  optimal  first-order  controllers  for  one-dimens^ional,  single-input/single-output 
parabolic  (heat/diffusion)  and  hereditary  control  systems.  The  numerical  studies  that  we  have 
carried  out  indicate,  at  least  for  the  e.xamples  that  we  have  considered,  that  convergence  of  the 
compensator  gains  is  achieved  and  that  using  the  first-order  controller  wouid  lead  to  only 
minima!  performance  degradation  over  a  standard  LQG  compensator  while  simplifying  the 
implementation  significantly. 

At  this  point  one  is  led  naturally  to  ask  the  question  of  whether  or  not  a  satisfactory 
convergence  theory  could  be  developed.  We  are  working  on  this  at  present  and  expect  that  such 
a  theory  would  conform  closely  in  form  and  spirit  to  the  convergence  results  for  LQG 
approximation  found  in  References  9  and  10  and  outlined  in  iection  2  above.  We  also  intend 
to  consider  our  approximation  'deas  in  the  conte.xt  of  discrete-time  or  sampled  data  systems, 
and  for  continuous-time  systems  involving  unbounded  input  and/or  output  (e.g.  boundary 
control  systems)  and  systems  with  control  or  measurement  delays."  '^  Finally,  we  intend  to 
investigate  the  application  of  our  appro.xi.v.ation  framework  to  other  infinite-dimensional 
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control  systems,  in  particular  the  vibration  control  of  flexible  structures  (i.e.  second-order 
systems  such  as  wave,  beam  or  plate  equations). 
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Minimal  Complexity  Control  Law  Synthesis,  Part  1: 
Problem  Formulation  and  Reduction  to 
Optimal  Static  Output  Feedback  * 

C.  N.  Nett »  D.  S.  Bernstein  <  W.  M.  Haddad  > 


Abstract 

The  overall  goal  is  thie  eeriet  of  three  papen  u  to  make  progreu  towardi 
the  development  of  a  control  law  deiigs  methodology  which  aupporta 
the  following  paradigm:  Minimise  control  law  complexity  anbject  to  the 
achievement  of  a  speci&ed  accuracy  in  the  face  of  a  spedfied  level  of 
uncertainty.  We  achieve  this  goal  by  developing  a  general  theoiy  of 
optimal  constrained'ftmetnre  dynamic  ontpot  feedback  compensation. 
By  applying  this  theory  in  an  iterative  fashion,  where  here  the  indicated 
iteration  ocenr*  over  the  choice  of  the  compensator  dynamio-stmetare, 
the  paradigm  stated  above  can  in  principle  be  realised. 

In  this  Part  1  of  this  series  of  papen  the  optimal  eonstrained-stnetnre 
dynamic  ontpnt  feedback  problem  is  formnlated  in  general  terms.  A 
method  for  reducing  optimal  conatrained-stmctnra  dynamic  ontpnt 
feedback  problenu  to  optimal  static  ontpnt  feedback  problems  is  de¬ 
veloped.  This  rednetion  procednre  is  concretely  illostrated  for  nine  spe¬ 
cial  cases  of  the  general  optimal  constrained-stmetore  dynamic  ontpnt 
feedback  problem.  Taken  together,  these  nine  snedal  cases  contain  most 
cases  of  mtereet  in  applictlLz:  Fliialiy,  the  utility  of  these  resnlts  in  ap¬ 
plications  is  described  it  some  detail  Here  we  consider  implementation 
istnes  sneh  as  operational/physkal  constraints,  operating-point  varia¬ 
tions,  and  processor  tkronghpnt/memory  limitations,  and  dcKtibe  how 
anti-windup/bampUsc  transfer,  gain-schednling,  and  digital  processor 
implementatioe  can  be  facilitated  by  apriori  constraining  the  controller 
dynamic-stmetnre  in  an  appropriate  fashion. 

In  Part  2  of  this  series  of  papers  a  general  theory  of'optimal  static 
output  feedback  compensation  is  developed.  This  theory  addresses  both 
H2  and  performance  objectives,  and  in  each  ease  provides  a  Riccati 
equation  eharceterisatioo  of  optimal  static  output  feedback  compensa¬ 
tion. 

In  Part  3  ot  >jis  series  of  papen  numerical  methods  are  developed  for 
solving  the  systems  of  coupled  Riccaii  equations  which  emsnate  from  the 
general  theory  of  optimal  coiutrained-structnre  dynamic  output  feed¬ 
back  compensation  developed  in  Farts  1  and  2. 

1  Introduction 

In  light  of  i)  the  increasingly  complex  nature  of  the  systenrs  requir¬ 
ing  controls  and  ii)  the  incrsasmgly  stringent  accuracy  required  of  con¬ 
trolled  sytteiiu,^  the  predominate  considerations  in  control  law  design 
for  modern  engineering  systems  have  become  control  law  complexity 
and  control  law  robustness,  respectively.  Indeed,  with  i)  comes  in¬ 
creasing  and  usually  ovetri^g  concern  with  system  cost,  reliability, 

'This  pspw  appears  in  the  Proceedinp  ottbe  IMP  American  Contra!  Confeeenca 
and  has  bran  eub^tted  tor  publication  la  the  IEEE  TVaniections  on  Autoreulc  Con¬ 
tra].  The  wotfc  of  the  first  author  on  thie  paper  was  supported  by  the  GE  Corporate 
Raeeerdi  and  Development  CenUr,  The  work  of  the  second  end  third  authors  on  this 
paper  was  supported  by  the  Air  Tent  Oflee  of  So'entlKc  Eeeeacch  under  ccntract 
Pe9<}(Vtp.C-0011  and  by  the  Harris  Corporation  Covemment  Aerospace  Systems 
Division. 
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and  maintainability,  and  with  ii)  comes  increasingly  complex  control 
syitems.  Since,  generally  speaking,  the  more  complex  the  control  sys¬ 
tem,  the  more  it  costs,  the  less  reliable  it  is,  and  the  harder  it  is  to 
maintain,  it  follows  that  i)  and  ii)  conflict  with  each  other  through  the 
specification  of  control  syitcm  complexity.  Similarly,  with  i)  comes  in¬ 
creasing  levels  of  aystem/eavironmental  uncartainty,  aad  with  ii)  comes 
control  systems  which  are  increatiagly  robust  relative  to  a  fixed  level 
of  system/eavironmental  uncartainty.  As  the  maximal  achievable  level 
of  robostnese  decreases  an  the  level  of  system/environmeiital  uncer- 
teiaty  increaaee  (16,17|,  it  follows  that  i)  and  ii)  are  aleo  in  conflict  with 
each  other  through  the  specification  of  control  system  robustnees.  Cor¬ 
respondingly,  control  law  complexity  and  control  law  robustness  are, 
respectively,  the  predominant  considerations  in  control  law  design  for 
modem  engineering  systems. 

In  light  of  the  above,  it  stems  both  natural  and  appropriate  to  pos¬ 
tulate  the  following  paradigm  for  control  law  design  for  modem  en¬ 
gineering  systems:  Minimise  control  law  complexity  subject  to  the 
achitvement  of  a  sptcified  accuracy  in  the  face  of  a  specified  level  of 
uncertiinty.^  Correspondingly,  the  overall  goal  in  thie  seriee  of  three 
papers  is  to  make  progresa  towards  the  development  of  a  control  law  de¬ 
sign  methodology  which  supports  this  paradigm.  We  achieve  this  goal 
by  developing  a  gebaral  thsoty  of  optimal  eonstrainkd-stmetnrt  dynamic 
output  fetuback  compensation,  where  here  constrained-structure  means 
that  'he  dynamk-stmeture  (s.g.,  dynamic-order,  pole  locations,  tero 
locations,  etc.)  of  the  output  feedback  compensation  is  apriori  con¬ 
strained  in  some  way.  By  applying  this  theory  in  an  iterative  faahion, 
where  here  the  indkated  iteration  occurs  over  the  choice  of  the  compen¬ 
sator  dynamic-stmetnre,  the  paradigm  stated  above  can  in  principle  be 
realised. 

1.1  Overview 

In  this  Part  1  of  this  scries  of  papers  the  optimal  constrained.4tmctnre 
dynamic  output  feedback  problem  is  formulated  in  general  terms.  A 
method  for  reducing  optimal  constrained-stmeture  dynamic  ontpnt 
feedback  problems  to  optimal  static  output  feedback  problems  is  de- 
vcloped,  bMcd  on  star  products,  linear  fractional  transformatkns,  and 
linear  fractional  decompositions.  This  reduction  procedure  is  conerstely 
illustrated  for  nine  special  cases  of  the  general  optimal  constrained- 
structure  dynamic  output  feedback  problem.  Taken  together,  these  nine 
special  caaes  contain  most  cases  of  interest  in  applications.  Finally,  the 
utih'ty  of  tbess  resnlts  in  applications  is  described  in  some  detail  Here 
we  consider  implementation  isaues  such  as  operatioual/pbyskal  con¬ 
straints,  operating-point  variations,  and  processor  thronghpnt/msmoiy 
limitations,  and-  describe  how  anti-windnp/bumpless  transfer,  gain- 
scheduling,  afii)'digital  processor  implementation  can  be  facilitated  by 
apriori  constraining  the  controller  dynamic-structure  in  an  appropriate 
fashion. 

In  Part  2  of  this  series  of  papers  [3j  a  general  theory  of  optimal  statk 
output  feedback  compensation  it  developed.  This  theory  addretses  beta 
Ba  and  B„  performance  objectives  in  a  general  way  by  considering  an 
B3  objectivs  subject  to  an  B„  constraint.  Within  this  set-up  analytical 
cbarsctcrisations  of  optimal  statk  ontpnt  feedback  compensation  are 
given  in  the  form  of  systems  of  conpisd  Riccati  equations,  aad  ahown 

^la  itymsa’s.twms,  this  pirsdjfm  sunpiy  requlrss  Uist  control  levs  be  desigaed 
to  be  '»e  simple  m  poeeible,  but  no  •implir'.  As  euch,  thie  ptrsdlgm  ie  resdily  seen 
to  be  nothing  more  thsn  a  reelalement  of  the  famous  maxim  of  Eimtein  which  has 
for  so  long  been  the  creed  of  tuKeaahil  practicing  engineers. 


d. 


to  jitld  (olntioiu  to  tbt  nine  tpecUl  emt  of  tht  optimal  conatraiscd* 
ttnctnr*  djrsamic  oatpot  feadbaclc  probUm  conaidtrad  ia  Part  1. 

In  Part  3  of  tbit  acrici  of  papcrt  [l]  namarical  matboda  art  devct- 
op«d  for  aotviac  tbe  ayaUma  of  coapkd  Riecati  aqaationa  wbieb  am* 
aaata  from  tba  gauaral  tbaory  of  optimal  coaatTaiaad>atractnra  dynamic 
ontpat  faadbadc  companaation  davalopad  in  Parta  1  and  2.  Exiatcnee 
of  ^Btiona  ia  conaiderad,  aa  ia  oniqaanaaa  of  aolationa.  A  bomotopy 
mat’^od  ia  propoaad  for  tbe  eolation  of  tbaaa  ayatame  of  coapled  Ricatti 
aqaationa,  and  tba  method  ia  concretely  illaatratad  by  aavaral  namerical 
examplaa  derivad  bom  a  faa  tarbina  anfina  control  danfn  problem. 

1.2  Key  Contributions 

Thera  art  two  particnlarly  noteworthy  eoatribntiona  of  tbia  aenaa  of 
papers  beyond  tba  specific  technical  contribntiona  not  id  above.  Firat, 
many  reacts  on  optimal  dynamic  oatpot  feedback  companaation  ra* 
cantly  obtained  by  other  aatbora  (a.p.,  (S|)  are  readily  aboam  to  be  bat 
•pedal  cases  of  tba  raaalta  on  optimal  static  ontpat  feedback  companaa- 
tion  prasantad  in  this  series  of  papers.  Aa  aacb,  a  sifnificant  anification 
of  many  known  raaalta  in  optimal  control  theory  is  acbiavad  tbroo(b  tba 
raaalta  presented  in  tbit  sarias  of  papers.  Second,  the  rasalts  presented 
in  this  series  of  papers  provide  a  tbaoretical  r  '-o  for  tba  analytical 
datisn  of  optimal  'indaatiy  standard*  controUars,  aacb  at  proportional, 
intsfral  (P>I)  controUara  and  lead-lac  compensators,  to  cite  bat  a  few 
examplas.  Constqaantly,  we  faal  strongly  that  the  resalts  preaentad  ia 
tbit  aarirs  of  papers  will  do  mack  to  help  bridge  the  gap  that  enrrentiy 
exists  batwaaa  control  tbaory  and  control  practice. 

1.S  Organixation  of  Part  1 

An  ontlina  of  tbia  paper  is  u  follows:  In  Section  2  wa  poor  the  math- 
ematical  foondation  opon  wbieb  the  p^ar  is  based.  In  Section  3  tba 
optimal  conttraiaad-ttmetnre  dynamic  oatpnt  feedback  problsm  is  for* 
malatad,  and  ia  Section  4  its  radaetion  to  tba  optimal  static  ontpat 
feedback  problem  is  presented.  Finally,  conclosions  are  given  in  Section 
5. 

2  Mathematical  Foundation 

In  this  section  we  poor  tbe  mathematical  foondation  apon  which  this 
paper  will  be  based.  We  begin  by  considering  tbe  two-inpat,  two-oatpnt 
(TITO)  system  depicted  in  Fig.  1.  Here  T  is  a  partitioned  proper  real- 


Fignre  1:  TITO  system  representation 

rational  transfer  matrix,  to  which  we  associate  a  partitioned  atandard 
state-space  rsalisation: 


In  order  that  the  system  repctMntation  (1)  be  completely  general 
ws  win  permit'  the  tbe  aca  of  tbs  so-called  empty  matrix  |10].  Tbt 
empty  matrix,  denoted  | ),  is  aa  eatry-less  matrix  with  dimensions  0x0. 


Proceeding  in  aa  obvions  way,  standard  matrix  operations  are  readily 
extended  to  encompase  the  empty  matrix.  Those  extensions  required 
for  onr  pnipoeee  here  are  sommarised  below: 

Definition  2.1  7A<  bompote  of  the  empty  matrix  it  ike  empty  matrix, 
fknktrmort,  fittn  say  mstriz  M,  its  proiact  vith  tkt  empty  matrix  u 
tilt  tmpty  matrix,  and  hotii  iU  turn  and  its  adjoinmtni  vitii  the  empty 
matrix  art  fittn  hf  M. 

Onr  interest  in  the  empty  matrix  here  stems  from  its  rather  eignificant 
ntility  relative  to  representing  static  and/or  SISO  ayatems^  in  terms  of 
(1).  To  illastrate  this  ntility,  consider  first  ths  cise  of  a  italic  lyitsm  M. 
Using  the  umpty  matrix,  a  state-space  realisation  of  M  can  be  written 
aa  follows: 

"'-[II  u\-  w 

Note  here  that  while  the  empty  matticea  in  (2)  can  bo  replaced  by 
aero  matrices  without  invalidating  (2),  to  do  so  adds  nncontrcllabk 
and  nnobservable  rigid  body  modts  to  ths  realisation,  which  is  clearly 
undesirable.  Conaideting  now  the  ease  of  a  SISO  system  U,  we  use  the 
piopeitiee  cf  the  empty  matrix  to  write: 


This  conatmet  provides  ns  with  two  distinct  TITO  rspiessntationa  of 
M,  corresponding  to  two  different  choices  for  a  noil  inpnt-ontput  pair  ia 
Fig.  1.  Thronghont  the  sequel  the  constmeta  provided  in  (2)  and  (3)  will 
be  ntiliied  extensively  ia  order  to  facilitate  aa  integrated  development 
of  results  for  ststic  and/or  SISO  syatems  within  the  context  of  TITO 
systenu. 

As  is  diaensaed  in  some  detail  ia  |12),  the  TITO  system  caa  be  re¬ 
garded  as  the  most  general  operator-theoretic  form  of  system  represen¬ 
tation.  The  diatingniahing  cbaractariatie  of  this  system  ia,  of  conrte,  tbe 
partitioaiag  of  tbe  ayatem  iapnU  and  ontpnta  into  two  vectors  each.  Be- 
canae  of  thk  partitioaiag,  anotiliied  ontputa  sad  namaaipalated  mpsta 
need  not  be  ignored  when  considering  system  iaterconaectioas;  rather, 
they  are  exph'citly  represented.  Coireipoadiagly,  in  considering  the  gen¬ 
eral  interconnection  cf  two  TITO  systems,  which  we  shall  now  do,  one 
is  ia  fact  considering  the  meat  general  form  of  system  interccaaKtioa. 


2.1  The  Star  Product 

Consider  the  two  TITO  systems 


and  awnma  that  the  danenaiona  of  tjj  and  the  traaapoee  of  Tji  arc 
identical.  Under  this  assomptioa,  we  may  interconnect  (  and  T  aa  iadi* 
cated  in  Fig.  2  to  yield  yet  another  TITO  syttem,  wbieb  we  denote  by 
7.  Recalling  Fig.  1,  it  shoald  be  apparent  to  tbe  reader  that  standard 
parallel  interconnKtion,  caecadc  itcrconneetion,  and  feedback  intercon¬ 
nection  are  all  special  cases  of  the  TITO  interconnection  depicted  in 
Fig.  2.  Indeed,  with 


tbe  interconnection  depicted  in  Fig.  2  describee  tbe  standard  parallel  in¬ 
terconnection  of  the  two  systems  Af  and  N.  Similarly,  standard  cascade 
interconnKtion  of  and  N  ia  deacibed  by  Fig.  2  when 


*orceun«,  ben  SUO  bmus  tiafle  netor  isput,  slnsle  vKtor  output,  in  coatnst 
to  Its  usual  usa«e. 


Z 


Ftgnrt  2:  IntcrconBcctioB  of  two  TITO  syttenu 


and  ttandard  fcadbadt  intarcoantetion  of  Id  and  S  it  dtteribcd  by  Fig.  2 
when 


Since  ttandard  paralltl,  eateadt,  and  feedback  interconnectiona  art  the 
batic  boildinf  blockt  of  tyitem  iatereonaection,  it  foUowt  that  the  TITO 
interconnection  depicted  in  Fi(.  2  it  a  corapktely  (tntral  form  of  tyttem 
iateteonnectioa. 

A  transfer  matrix  formula  for  TITO  mtereonnection  can  be  derived 
via  a  tenet  of  straightforward  but  tedions  algebraic  manipulationt  (IS, 7]. 
Doing  to,  we  obtain  the  following  exprettion^  for  the  interconnection, 
T,  of  t  and  T  depicted  in  Fig.  2: 

^1  T»iir-t„Tt,)-Uu  T«  +  r,,M^-Tut»r*T„  j- 

(9) 

It  it  in  terms  of  this  formula  that  the  totalled  star  product  (1S|  of  two 
TITO  tyttemt  it  defined: 

JJeflnItion  3.3  Consider  the  two  TITO  sjritems  t  «nd  T  desenied  hjr 
f4)  and  (5),  mp<ctiwt!y,  Tk*  tier  prodnet  of  T  vitk  t,  denoted  t*T, 
it  defintd  as  the  TITO  sgstem  T  given  if  (9). 

Implicit  in  the  above  definition  of  the  star  prodnet  of  two  TITO  tjra- 
Uma  k  the  definition  of  the  star  prodnet  of  two  appropriately  partitioned 
constant  (i.c.,  real,  complex)  matriett.  At  such,  we  may  view  the  star 
prodnet  of  two  TITO  tyttemt  m  the  pointwite  ttar  product  of  their 
frequency  cvahiatioBs. 

In  light  of  the  corrapondenee  between  the  star  prodnet  and  TITO 
interconnection,  it  should  comt  at  no  surprise  to  tht  reader  that  the 
star  prodnet  is  astocintivt  (IS): 


Fact  3.1  Giun  tknc  TITO  tftUnu  t,  T,  and  r. 


(t*T)*rwt«(T  wt). 

A  state.tpacc  formula  for  the  star-product/TITO  iatereonnectioa  can 
be  derived  via  a  teriet  of  straightforward  but  tedious  algebraic  man^ 
nlatioBS  [7|.  Doing  to,  wt  obuin  a  formula  for  a  ttate.tpaec  realstation 
of  7  w  (  •  T  in  terms  of  state-space  rtalisations  of  t  and  T : 

Fact  3.3  ConMtr  iJi*  thru  TITO  systems  t,T,  and  T^ttoT.  Sup- 
po$t  that  t  and  T  art  dsscnhtd  hy  (4)  and  (5),  ntpocdutlf,  and  dsaate 
ika  tiaU-u€cfort  eotrttpendinf  to  At  ruItuHont  of  t  and  T  yivtn  tn 
(4)  and  (5)  if  Sf  *Ti  ruptetittlf.  Undtr  Utti  condiiioiu, 


*Th<outbeut,  any  IcClestsd  matrix  cxpreaalsa  is  aiimail  to  {antve  matriesa  of 
coopetlbie  dimnwleas,  and  UBf  Isdkaled  matrix  iovane  is  aeiuitad  to  adtt. 


..  "-[«]•  <“l 

The  statc-ipace  formula  for  the  itar  prodnet/TITO  interconnection 
given  in  Fact  2.2  it  particularly  convenient  for  numerical  implementa¬ 
tion.  Indeed,  to  implement  (10)  in  XATIAB  |10]  we  wonld  first  implement 
the  constant  matrix  vtrsion  of  (9)  u  the  m-filc  star..ixq,  whid  could 
of  conrae  be  called  on  a  frequency-by-freqnency  bMis  to  compute  the 
transfer  matrix  venion  of  (9).  Next,  wt  would  implemtnt  (10)  as  the 
m-Sle  star..at,  where  here  star.as  would  simply  call  atar..frq  four 
timet,  with  appropriate  arguments.  The  retultiag  implementation  of 
(10)  wonld  be  comprised  of  only  ^  MATtAB  m-filtt,  and  each  m-filc 
would  contain  only  a  few  linM  of  c^c. 

Recalling  that  TITO  mteiconnectioB  it  a  completely  general  form 
of  system  interconnection,  we  add  that  the  elegant  implementation  of 
the  ttar  prodnet/TITO  mterconaectioB  ontUned  ihovc  could  in  turn 
be  called  by  other  m-filet,  with  arguments  at  indicated  in  (0)-(8),  to 
generate  mote  standard  tyttem  interconnections.  Coatianing  in  this  vein 
one  conld  in  principle  implement  a  completely  general,  yet  extremely 
compact  computational  facility  for  system  inteiconnectioa,  with  only  a 
modest  effort.  Consequently,  we  would  expect  to  toon  tec  the  TITO 
system  representation  and  the  star  prodnet  ineorported  within .  'kting 
CACSD  packages,  such  as  [10,9,4]. 

3.3  The  Linear  Fractional  Transformation 

In  thk  section  we  consider  the  general  iatereonnectioa  of  a  TITO  sys¬ 
tem  with  a  SI50  system  at  depicted  in  Fig.  3.  As  it  snggested  by  the 


Figure  3;  Interconnection  of  a  TITO  tyttem  with  a  SISO  tyitem 

notation,  the  interconnection  depicted  in  Fig.  3  it  bnt  a  special  cate  of 
the  general  mterconnectiott  of  two  TITO  systems  depicted  in  Fig.  2.  To 
give  a  precise  mathemuical  statement  of  this  cotretpondeace  we  make 
nse  of  the  properties  of  the  empty  matrix  and  the  definition  of  the  star 
prodnet  to  write: 


»» 1, 

if 

[hi 

hai 

1  (1 

(ii 

jrii 

1  11  (ij 

1  (1 

nJ 

Thongh  (12)  completely  describes  the  intereoanection  depicted  in 
Fig.  3,  for  Botational  timpheity  h  it  desirable  to  introduce  an  abbre¬ 
viated  notation  to  dcscrib'S  the  correspoadeace  between  (,  7|i,  and  7 
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implkit  is  (13).  Tlik  kad*  vs  to  dt£nt  t}i*  •o.calUd  Shmt  fractional 
tranafonnatioB  |15]  ol  a  SISO  arttam  uidtr  a  TITO  ijntam  m  foQcnn: 

StflniUoa  3.S  Comidtr  ik*  TITO  ifsUm  t  iitcrUU  if  (^}  A* 
SISO  BftUm  Til.  Tk€  livur  fnetionvl  trvmfomvtiov  of  Tn  %%itr  t, 
i*%oUi  toTii,u  Jtfitud  at  A*  SISO  ijiUm  7ii  fivca  if; 

Til  =  til  +  tisTii(7  -  tMTii)~*t2i.  (13) 

To#  ntility  of  the  linear  fractional  tranaformatios  lita  with  the  fact 
that  it  enablea  (12)  to  be  compactly  reatated  aa  (13).  Aa  intereonnec* 
tiona  of  the  fonn  depicted  in  Fi(.  3  play  a  key  role  in  the  aeqnel,  thia 
notatbnal  aimplication  doea  rnoch  to  atreamline  the  remainder  of  thia 
paper. 

For  praciaiott  in  what  foDowa,  a  formal  atatement  of  the  corraapon* 
dtnca  ^tween  the  atar  prodnet  and  the  linear  fractional  tranaformation 
ia  (iven  below.  The  prool  of  thia  remit  ia  immediate  aaiag  the  definitiona 
of  the  atar  prodnet  and  the  linear  fractional  tranaformation: 

Fact  3.S  ContUtr  At  TITO  tftltm  t  and  At  two  SISO  tftUmt  Tix 
aai  Til.  Vadtr  Attt  eoadthbne,  At  follofttnf  Ant  atalementi  are 
,  efiuWent: 

f.  Tit  nUSon  Tu  w  to  7ii  koldt. 

t.  Titn  txitt  SISO  tftitmt  Tu,  Tji,  and  Tu  /ar  wkick 

r.i-[/  0]  (t.T)  [J], 

wAer*  here  T  u  de/ined  in  At  oiviout  fttiion. 

S.  Tit  nlaiiov 

r,i«[/  0]  (t.T)  [J] 

kelit  for  til  SISO  tytUmt  Tu,  Tju  and  Tu,  *itn  ken  T  it  dt- 
fiatd  in  At  oitiovt  fatkion. 

The  following  property  of  the  linear  fractional  tranaformation  playa  a 
key  role  in  the  aeqneL  Ita  proof  ia  immediate  naing  the  definition  of  the 
the  linear  fractional  tranaformation: 

Fact  3.d  Coniider  Ae  TITO  tfiUm  t  dtterHed  if  (4)  tad  define  At 
followinf  fanetion: 


3.3  SpecUlizationt  for  Static  Right  Operand! 

In  thia  aection  we  apecialiae  the  atate.apace  formnlaa  for  the  atar  prodnet 
and  the  Kncar  fractional  traruformation  given  by  (10)  and  (16),  reapee- 
tively,  to  the  eaae  where  the  right  operand  in  the  raapective  operationa 
ia  a  atatic  ayatem.  To  do  thia,  we  begin  by  aaanming  that  T  and  7ii 
aa  deaeribed  in  Facta  2.2  and  2.5,  rcapecthrcly,  arc  atatic  ayitema.  Next 
we  apply  the  conatmet  for  atatic  ayitema  given  by  (2)  to  T  and  Tii, 
reipectively: 


Snbetitnting  now  from  (18)  into  (10)  and  aimplifying  the  reailting  cz- 
preaaiona  naing  the  propertiea  of  the  empty  matrix  and  the  definition  of 
the  atar  product,  we  obtain  the  following  apecialiaation  of  Fact  2.2: 

Theorem  3.1  Centider  At  Ant  TITO  tfiUmt  t,  T,  andT *t*T. 
Svffott  Aat  t  it  dtteriitd  if  (4),  ani  denote  Ae  tUU-oeetor  torn’ 
tfondinf  to  Ae  nalitation  of  t  fiotn  in  (4)  if  Finallf,  ottamt  Aat 
T  it  a  lAtie  tftttm.  Under  Attt  conditiont. 
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and  Ae  etate-reetor  zy  defined  if  (tO)  it  z,. 


(20) 


k[-)‘-  Til  •-»  to  Til, 

vktn  ken  Tu  it  an  ariitrarf  SISO  if  item.  Under  Attt  eonditioni,  !(•) 
it  affint  if  and  onlf  if  ha  a*  0,  in  tekiek  tote  tu  w  i(0).  FarAtrmon, 
!(■)  ia  Kntar  if  and  only  iftu^O  and  tu  w  0. 


A  itate-apace  formula  for  the  Unear  frraetional  tranaformation  foDowa 
immediately  from  the  correapondiiig  formula  (10)  for  the  atar  product 
via  the  corTcipondenca  between  the  atar  prodnet  and  the  linear  frac. 
tional  tranaformation  gtvea  in  Fact  3.3.  Indaed,  writing: 


where  here 


(M) 


(15) 


we  need  only  mbetHute  (if)  into  (10)  to  obtain  the  following  coroDaiy 
toFbct24: 


Fact  3.S  Contidtr  At  TITO  tftlem  t  and  At  two  SISO  tfifttni  Tu 
and  Til  w  toTii.  Saffoit  Aat  t  and  Tu  an  dtteriitd  if  (4)  and  (15), 
nipeetioelf,  and  denote  At  etaU-otetort  conttfondinf  ia  At  rneHac* 
tMaa  of  t  and  7ii  giaen  in  (4)  and  (15)  if  zt  end  xy,,,  niftetittlf. 
Under  Attt  eonditioni. 


Similarly,  aobetitnting  from  (19)  into  (16)  and  aimplifying  the  reenlting 
expriiiiona  naing  the  propertiea  of  the  empty  matrix  and  the  definition 
of  the  linear  fractional  tranaformation,  we  obtain  the  following  apecial- 
iaatiott  of  Fact  2.5: 

Theorem  3.3  Contidtr  At  TITO  ifitemi  t  and  Ae  (n*o  SISO  ifiUmt 
Tu  and  Til  ••  *  ®  Tii.  Svffoit  Aat  t  it  deieriied  if  (4),  and  denote 
At  etaU-oector  eorretfondinf  to  At  nalitation  oft  fittn  in  (4)  if  z,. 
Finallf,  aiiamt  Aat  Tu  it  a  ttatie  tftttm.  Under  Aeit  eonditioni. 
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and  At  tteU-otelor  zj-„  defined  if  (tl)  it  if 

The  reader  ahonid  make  careful  note  of  how  the  kft  operand  on  the 
right-hand  aide  of  both  (20)  and  (21)  ia  partitioned.  Thia  ia  not  a  typo¬ 
graphical  erron  in  fact,  the  right-hand  aidca  of  both  (20)  and  (21)  would 
be  undefined  if  the  partitioning  of  thia  matrix  waa  the  *atudard*  par¬ 
titioning  indicated  in  (f ). 

Intenatingly,  Theorema  2.1  and  3.2  ahow  that  the  operation  of  atate- 
apace  realiaation  ‘diatribntea*  over  the  operationa  of  atar  prodnet  and 
linear  fractional  tranaformation  when  the  right  operand  ia  a  atatic  aye- 
tern.  Indeed,  for  atatic  right  operanda  the  atar  produa  opentag  on 
tranafer  matricea  corraaponda  to  the  atar  prodnet  operating  on  the  coc^ 
reaponding  atate-apaee  raaliaationa,  appropriately  partitioned,  and  aimi- 
larly  for  the  linear  fractional  tranaformation.  In  the  language  of  abetract 


« 


a](«br«,  fUt»4pKt  niEiatioa  ii  tba*  mui  to  b«  a  znoipUun  from  th« 
Mt  of  tr«a<f«r  matricae  to  thi  Mt  of  itata^aM  rtaliiatMU  uaitr  the 
oparatioM  of  atar  pro<]act  aad  linaar  fractional  traaifonnatios  witb  a 
atatic  xiflit  oparaad.  Thoafb  wa  baliava  it  Uiu Ijr  that  tbaaa  obaervationa 
balia  a  daapar  ai(aificanea  of  Tbaorama  Z1  and  3.2,  no  forthir  dtvalop- 
maat  alonf  thaaa  liaaa  will  ba  attamptad  bara  aa  &  would  taba  at  too 
far  afiald. 

Tbaorama  2.1  and  2.2  play  a  bay  rola  in  tba  aaqoal.  Tba  raaaon  for 
tbia  it,  of  conraa,  that  tbay  daaciiba  tba  aitaatioa  of  atatic  ootpnt  feed* 
baeb.  Indeed,  Tbm.  2.2  daaciibaa  tba  aitaatioa  of  atatic  oatpot  faadbacb 
companaatioo,  Tn,  applied  to  tba  dynamic  ayatam  t,  aad  aimiUrly  for 
Tbm.  2.1. 


3  Problem  Formulation 

la  tbii  aact.jB  tba  optimal  conatrainad-atractora  dynamic  oatpot  faad- 
bacb  problem  it  formulated  ia  faaaral  tanna.  Startiag  with  tba  fancral 
formalatioa  of  tba  optimal  (nacoaatraiaad)  dynamic  ootpat  feedback 
problem  atiliaad  ia  (6|,  wa  extend  tbit  aat*np  to  oncompaaa  tba  optimal 
coBatrainad*atmctora  dynamic  ootpnt  feedback  problem.  Tba  raaoltinf 
aat*np  ia  aa  indicated  in  Fi(.  4,  wbara  bara  g  it  tba  (ivta  dynamic  ayatam 


Fiforc  4;  Conatrainad*atractBR  dynamic  oatpot  feedback 


to  be  coatrollad: 
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and  k{K]  ia  tba  dynamic  controllar  to  ba  datifned: 


m  y 


(22) 


(23) 


Tbc  eaaantial  diatinctioa  batwaaa  tba  aat*Bp  depicted  ia  Fif.  4  aad 
tba  aat-ip  atiliaad  ia  [0]  ia  tba  foactioaal  dapaadaaca  of  k  aad  rtmK. 
Indeed,  ia  tba  aat*op  otOiaad  ia  [0]  tba  foBctioaal  dapaadaaca  of  k  oa 
K  ia  abeaat,  aad  r  ia  errittea  aa  a  (oactioa  of  k  ratkar  tkaa  K. 

Tbe  atenificaaca  of  tba  fanctioaal  dapaadaaca  on  if  ia  (23)  it  that  it 
pennita  tbi  dyxamie*atrBetbrt  of  tba  coatroBar  to  ba  cooatrained  apri- 
ori  ia  tba  problem  formolation.  To  do  tbit  wa  taka  iC  to  be  aa  arbitraiy 
rati  matrix  of  ixad  dimtationt,  aad  rtford  K  at  tba  *daaifn  param* 
atan*  ia  a  eoBttraiaed*atmctBrc  dynamic  coatreOar.  Corraapoadinfly, 
tba  fiuictioa  x(-)  ia  riewad  at  tpedfyiag  tbe  fixed  dynamic'atractora  of 
tba  coattraiaad-ttroctara  eoatroUar. 

la  order  to  provide  a  coacrata  UlnttratioB  of  tba  eoacapit  tat  fertb 
above  wa  coaler  a  timpla,  yet  importaat  example  of  conatraiaed- 
ttnetara  dynamic  ootpnt  feedback;  aamtly,  proportioaabiatagral  (P*l} 
coatrol.  A  controllar  of  tbia  form  can  ba  daeetibed  at  foUoara; 

+  (2<) 

wbara  bare  K,  aad  Xi  are  tba  proportional  aad  mtagral  gam  matricaa 
of  tba  eoatroUar,  raapactivtly.  Bated  on  (24),  wa  aoar  tat 


«{ff) 


‘  K3  +  — 


(25) 


in  order  to  conitrain  tbe  dynamic-atroctore  of  tbe  controller  to  a  P-I 
form,  where  here  K  can  ba  taken  at  either 


or 

Eqoivalently,  we  could  Mt  either 
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(20) 


(27) 


(20) 


(29) 

in  order  to  conatraia  tbe  dynamic-itmctnra  of  tba  eoatroDer  to  a  P*I 
form,^  where  here  K  it  taken  aa  in  (20)  ia  tba  cate  of  (20)  aad  (27)  ia 
tba  cate  of  (29). 

fVom  a  compotational  ataadpoint,  tbe  atatt'tpaca  apacificatioaa  (20) 
aad  (29)  are  typically  more  coavaniant  to  work  with  than  tba  traaafar 
faactioB  apacification  (25).  Which  of  tbaaa  two  atata-apaca  repeat aata- 
tiont  ia  moat  appropriate  depanda  on  tbe  dimaatioat  of  tba  P*I  controller 
in  (25).  Gtaerically,  (20)  ia  minimal  if  aad  only  if  the  controller  hat  at 
leatt  M  n'aay  ootpota  aa  inpnta,  aad  (29)  it  minimal  if  aad  only  if  the 
controller  bat  at  laaat  at  many  inpota  at  ootpota  (0).  At  toeb,  (20)  moat 
ba  ntiliaed  when  the  controller  baa  fewer  inpota  than  ontpota,  aad  (29) 
moat  be  otUiaad  when  tbe  controller  bu  fewer  ootpou  than  inpott. 

In  (20)  tba  dynamict  aad  controlt  ia  tba  controller  raaliaatica  are 
fixed  apriori  to  0  aad  /,  reapectively,  in  order  to  conatraia  tbc  dynaatic* 
atmetore  of  tbe  controller  to  a  P*I  form.  A  natnrel  extaation  of  tbia 
tat>np  it  to  allow  other  eboicae  of  fixed  dyaaatict  aad  controls  to  ba 
made,  beyond  tbc  apacific  eboicae  o(X)  *  0  and  P{,K)  w  I.  Paraaag 
tbit  extaation  raaultt  in  the  formolation  of  tbe  tbe  to-called  fixed  dy* 
namica/controlt  problem  (FDCP).  Liktwite,  a  natoral  extenaioa  of  (29) 
it  tbc  to-called  bed  dynamica/obMrvationt  problem  (FDOP).  Etch  of 
tbeae  two  probic'mt  ia  dcacribed  in  Table  1,  along  with  aevea  other  varia* 
tiont  on  tbia  tbema.  Taken  together,  tbeta  nine  apacial  catoc  of  the  gen* 
crtl  Mt-op  aufficc  to  bandit  moat  conttrained-atroctora  dynamic  oofpat 
feedback  problcmt  of  utereat  in  applicationa.  Nonetbeleaa,  we  are  qoi^ 
to  add  that  tbc  problcmt  cataloged  in  Table  1  repraeant  only- a  email 
fraction  of  tbc  total  capabilitiet  of  tbc  general  problem  formulation.* 

5.1  Optimality  Criterion 

Having  formolated  tbc  conttninad*ttroetnrt  dynamic  oatpot  feedback 
problem  ia  general  tarma,  wa  aow  adjoin  to  tbia  aat*np  aa  abetract 
notion  of  optimality  to  aa  to  be  able  to  diKota  tba  optimal  coaatrainad- 
atmetore  dynamic  ootput  feedback  problem  ia  general  tarma.  For  tbie 
potpoee  we  poatolate  tbe  following  design  objective  cotraaponding  to 
Fig.  4: 


Design  K  to  'optimise*  tbc  closed-loop  system: 
r(X):=yox(X), 

tobject  to  tbc  constraint  of  internal  stability.^ 


(30) 


*Tba  niliisUanc  fivio  ia  (tt)  and  (M)  an  eocilM  mlatiaal  nodal  caBcaicid 
foam  reilisuionc  |lt].  Aa  la  dUcuned  In  |1S]  end  clabontad  upon  is  lt>*  aceoel. 
Ihwc  caasRicaJ  foems  can  ba  luod  10  raeiUlsu  an  intafrated  derirn/implcmaatitlos 
of  neeltncsr  coniroltcn. 

'Omitted  fron  TVbb  1  an  the  so-caCed  thnw  block  probleae.  cactsln  “mbuf 
2-block  pioblwas,  and  deccntnlisod  control  pteblamc;  hovenr,  tfccir  fMaoulatioaa 
an  nadily  fwientad.  They  an  cmitud  hwo  boeauM  tbey  (In  riw  to  pcoblanw 
wbsn  the  sinjctun  at  K  it  coratnined,  and  va  wUi  lo  poetpoiw  a  Jiartsaiwi  at 
Ibis  caM  until  Sac.  (. 

^Tba  notion  of  Intanal  atabilily  bar*  It  tba  ututl  one,  dadnod  in  Unaa  ef  the 
rvalitatlonc  of  f  and  niff)  glvan  In  (13)  aad  (22),  raapacthrtly.  Pracitaly,  danctlwg 
Iba  atalo  voclon  oomaponding  to  tbaac  ratSsatiOM  by  Wf  tad  a,(X]>  rcapacUrtly, 
lasarsai  stability  bara  naans  tbu  Iba  conposlla  slate  vector  for  tba  cloaad-loop 
systani  formad  frons  sy  aad  a<[x}  daesya  to  aero  from  all  inllial  oondltloos  laidtr 
aaco  Inpul  ooaditlecis. 


Ir  tk«  tbav«  Um  daU  ar*  tka  plant  9  dneribad  by  (22)  and  tka 
dyRantic^nKtara  at  tka  controller.  Am  prtrioialy  diacnjMd,  tka  lat* 
tar  it  tpadfiad  in  tarsia  at  tka  fonction  /c(-)  or,  a(iniva}cstl7,  in  tamu  of 
tka  fonction 


[ 


a(.) 

n() 


(31) 


corratpondinK  to  a  raaliiation  of  «(■).  Tka  dttifn  objective  ia  tken 
to  ckooaa  tka  *&ae  paramaten*  K  in  tkit  fixed  dynamic-atractora  to 
*optimiia*  tka  cloaad*loop  ayatem  r[K),  aobjact  to  tka  conatraint  of 
iatemal  atabSity. 

Tka  opacification  of  optimality  in  tlje  above  it  eompktely  arbitrary, 
aobjact  to  tka  raqoiramant  tkat  only  r(-)  be  rt<iairad  for  ita  apecification. 
For  example,  in  Part  2  of  tkia  paper  |3)  tka  ontpnt  of  r(X)  in  Fif.  4 
ia  partitioned  into  two  componenta,  corraapondinf  to  tka  foUowiof  row- 
partition  of  r(X): 


(32) 


la  terma  of  tkit  partition,  tkc  foUowiaf  optimality  criterion  it  impoaad 

(2): 


mt'mimae  ||  ti[K)  |{a  tvijtet  to  g  t3(K)  <  i,  (33) 

wkara  kero  |  -  ga  and  ||  ■  g,.  are  tkc  f 2  and  Em  aonaa,  reapeetnely  [fl], 
Aa  tkit  notion  of  optimality  reqoirac  only  r(-)  for  ita  apecificatioa,  tka 
reqoiramcat  impoaad  above  ia  aatisfiad. 

Aa  diacTMaad  in  Part  2,  tka  notion  of  optimality  apacifiad  by  (32)  and 
(33)  addraaaaa  botk  S3  and/or  Em  parformance  criteria  in  a  fcneral  and 
flexible  way.  Aa  it  wall-kaown,  many  accuracy  and  roba^naat  eonccmi 
may  be  addreaaad  fay  wty  at  performance  criteria  of  tkit  type  (11). 


4  Reduction  Procedure 

Is  tkit  taction  wa  develop  a  fencral  matkod  for  radecinf  optimal 
coaatraiaadttmctara  dynamic  oetpnt  feedback  problama  to  optimal 
static  ontpnt  feedback  problama.  The  eaaeace  of  tkia  rednetion  pro- 
cadnte  it  illnatrated  is  Fif.  5.  In  abort,  k(K)  it  written  at  a  linear 


Fifsre  S:  Reduction  to  atatie  ontpnt  feedback 
fractional  tranafomuiion  of  K  nndtr 
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Tka  raanlt  ia  tka  static  ontpnt  feedback  problem  of  daei(nin(  tke  static 
K  for  tka  angmentad  plant  By  aolvisg  tkia  problem  we  obtain  a 
eolation  to  tke  optimal  eonatrainad-atmetnre  dynamic  ontpnt  feedback 
problem  of  dtaigninf  k[K)  for  the  ocijinal  plant  9.  Aa  tneh,  the  otifi- 
nal  optimal  coaatraiaad-ttnctnra  dynamic  ontpnt  feedback  problem  it 
cffectivtly  redneed  to  an  optimal  static  ontpet  feedback  problem. 

For  added  preeieion  in  wkat  followa,  tka  redaction  procedure  de> 
acribed  above  it  raatated  ia  mathematical  ternu  aa  the  following  al¬ 
gorithm: 

AZ  (Decoi&poaitloa):  Find  K  anek  tkat 

/t(K)*lCoX  (36) 

for  all  K,  witk  1C  independent  of  K. 

A2  (Augxse&tatlort):  Compute 

a:=^9*K.  (37) 

AJ  (OpUmiuUoa):  Find  K‘  which  'optimiaaa*  the  cloaed-Ioop  lya- 
tem 


r,[K) :»  GoX  (SI) 

defined  by  G  and  X,  tnbjact  to  the  conatraint  of  iatemal  atability. 

A4  ^mplementntion):  Compnte  x(A*). 

There  art  two  primary  qnaationa  wkkk  mnat  be  anawered  in  order  to 
place  the  above  algorithm  am  a  fim:  analytical  foundation:  Faet,  under 
wkat  conditiona  it  tka  algorithm  valid,  in  tkc  aaaae  tku  tka  action 
to  tkc  optimal  static  output  faadack  problem  yields  a  aolntion.to  tka 
•optimal  eonatramad-ttmetura  dynamic  ontpnt  feedback  problem?  Sec¬ 
ond,  under  wha  con^iont  can  the  algorithm  be  anccaaufnlly  axacutad, 
and  kow  can  the  variout  atapa  is  the  algorithm  be  ayatematietlly  exe¬ 
cuted  nndtr  tkcae  conditions?  From  these  two  general  qnsationa  nriae 
the  following  fonr  specific  technical  qnaationa: 

Qi  (Deeompositlca):  Under  what  conditions  dost  the  decompoti- 
tion  (38)  exist,  kow.w  it  dttenniacd,  and  to  what  extant  it  it  nniqnaly 
determined? 

Q2  (Augmcntatlco):  How  it  (7  in  (37)  computed,  and  to  wkat  extent 
it  G  uniquely  determined? 

QS  (Optimlxatlon];  Under  wkat  conditiosa  does  there  exiitt  a  soln- 
tion  to  the  static  ontpnt  fHdback  problem,. and  kow  is  this  aolntion 
datarmiaad? 

Q4  (ImpInaeaUtlon):  Under  wku  condHions  dote  K‘  yielded  by 
the  algorithm  ‘cqitimita*  tka  cloaed-'loop  aytUm  r(A)  defined  in  (30)7 

Q5  (Impleramtntion);  Under  what  condUiona  does  x(A’*)  yielded  by 
the  algorithm  intemally  atabiHae  p? 

With  the  exception  of  Ql,  each  of  the  qnettiona  posed  above  are 
anawered  in  tkc  remainder  of  tkia  section,  la  doine  ao,  the  validity  of 
the  redaction  procedure  ia  eatablitked,  and  ayatematic  methods  for  its 
exeentios  are  preaented.  We  proceed  ia  order  through  tke  questions  in 
OUT  development,  aatabliiking  a  separate  section  for  each  qnettios  aa  we 
proceed.  Throughout,  wa  will  make  free  naa  of  the  notation  aatablithad 
i®  (^)i_(23),  (30),  (34),  (35),  and  (38).  Howtver,  initially  only  9,  x(-), 
and  tteir  reclisationa  are  aatumad  given.  Finally,  we  will  denote  by 

*K§  and  xo  the  atata-vactora  conetponding  to  the  reaHaationa 

ot  9,  k[X),  K,  tmi  G. 

tta  reaolntioa  of  Q<  it  deferred  to  Parts  2  and  3  of  tkw  paper  [S,lJ, 
wherein  n  reasonably  complete  answer  to  this  qnettion  it  givta. 

4.1  Decompoiltlon 

In  that  section  Ql  it  answered.  We  begia  with  a  simple  extension  of 
Thm.2.2: 


nt*or«m  A.1  Tk€Tt  tiuU  K  wXiek  tUiiJU*  (3t)  i/  tJun  ttitU  «  te- 
Imiien  t»  tk*  foUaminf  rttl  mttris 
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Tht  tifnifcaAct  of  Tiun.  4.X  it  that  it'rtdaett  tha  qattcion  of  static 
linear  fractional  decompotition  of  the  dynamic  tytUm  /f(X)  to  the  qnea- 
tios  of  static  linear  fractional  dteomposilian  of  ihs  static  system 


which  it  simply  a  real  matris  problem.  Howeysr,  That.  4.1  it  not  coeo- 
pletely  satiefaetoey  for  two  important  rtasont:  First,  the  eonditiou  of 
the  theorem  art  oafy  safidsat,  and  not  ascsttiry.  Sscoad,  the  teal 
matrix  sqnatioa  (39)  it  aeaEaear,  and  heacs  difiealt  to  solve  ia  gsa> 
sraL  Thongh  ws  art  aaabls  to  alleviats  these  deCeisaeits  ia  the  fcaaral 
case,  ia  aa  important  special  cme  we  have  Imb  abk  to  alleviate  them 
compktely. 


Theorem  4.2  Sapfau  (41)  it  tffiitt  i»  K.  Undtr  this  coaiitic*,  tXttt 
tfitU  K  wkick  ttiufUt  (38)  if  sad  only  if  Ikert  taitU  s  tolttiiM  to  tkt 
fcllowiat  ntl  matrix  sftatiaa: 


The  X  compated  abovt  for  the  7DCP  is  cataloged  ia  Tabk  2,  along 
with  JC  cotrttponding  to  each  of  the  other  conttrained>straetBrc  dy> 
namic  ontpat  fecdbach  problems  cataloged  ia  Tabk  1.  For  each  of  these 
other  problems  A1  was  exseatod  as  oatlinod  above  asiag  Thm.  4.2  in 
order  to  obtain  K. 

In  order  to  cddrttt  the  keae  of  the  aniqaeness  of  K  aad  thereby 
compktc  oar  stady  of  Ql  we  present  the  following  simpk  rssalt: 

Theorem  4.S  ^xy  tolatio*  of  (fS)  ttiUjUt  tkt  fellewinf  nltHox: 

f  *  1  f  C,  A.  U  f  “W  ]  _  r  “(0)  ^(0)  1 

^‘ ]*[,(/}  f(/)j  [i(0)  f{0)J- 

As  will  be  shows  in  the  next  section,  Thm.  4.3  k  aQ  that  k  reqaxed 
to  completely  characterise  the  extent  to  which  G  ia  (37)  k  aaiqiiely 
detenniaed. 


4.2  Augmentation 

la  thk  section  QS  k  aaswsrsd.  Thronghont,  ere  assame  that  (41)  k 
affine  aad  a  realisation  dtxK  satkfymg  (36)  has  been  compat^  via 
Thm.  4.2.  As  iadicated  ia  the  last  section,  fittk  k  kst  by  imposisg 
these  two  assnmptions.  For  convsnisace,  we  also  sesame  that  dm  ae  0. 
Iktk  k  lost  by  imposmg  thk  assnmption,  too,  as  ^  0  whenever 
sensofs  aad  actaators  are  modslkd  as  bandKmited  devices. 

We  begm  by  giving  aa  explicit  formala  for  G  deia^  in  (37)  based  on 
Fact  2.2: 

Theorem  4.4  Sxppett  (37)  kolit.  Ukitr  tkit  teadiXe*, 


ra(X) 

d(N)l 

r  a(0) 

^(0)  ]  , 

5{X)  j 

It(o) 

5(0)  J 

1  A  J 

At  1.  («) 


in  whkh  sale 


r  ofo) 

do 

01 

K 

7(0) 

5(0) 

"AT 

Oil 

0 

soiree  (38). 

The  proof  of  Thm.  4.2  mahea  ase  of  Thm.  4.1  aad  Fact.  2.4  in  a 
straightforward  wqr.  Note  that  the  coadiUons  of  Thm.  4.2  arc  both  aec- 
essaty  aad  snfficieat,  aad  tbs  real  matrix  eqaation  (42)  k  Kaear.  Thk 
snprovement  over  Thm.  4.1  has  corns  at  the  expense  cf  the  assamptioa 
that  (41)  k  aSae.  However,  thk  aasamption  k  satkfied  in  most  appSca- 
tions  of  interest.  As  evidence  to  sipport  thk  claim  are  note  that  e^  of 
the  constraiaed^tmetnrs  dynamic  ontpat  fltedbach  problems  cataloged 
in  Tabk  1  satkfies  thk  assnmption. 

In  order  to  iUnstrate  the  signiScaat  ntility  of  Thm.  4.2  ia  sxscating 
Al,  consider  the  FOCP  cataloged  in  Tabk  1.  Aa  noted  abort,  (41)  k 
affine  ia  thk  problem,  so  we  may  apply  Thm.  4.2  to  immediately  rtdsce 
tbs  compatation  of  X  in  Al  to  the  solntioa  of  (42),  which  ia  thk  case 
rednees  to: 


[ft  *,]-[%]'*■  *’11'^  ‘^‘1- 

By  iaspoction, 

[£]-[;]  • 

soivnt  (44).  SnbstitBtiBg  (45)  iato  (43)  wn  obtain: 


d.  Ol 

_2J 

0  I 

0  0 

0 

I  oj 

thns  coepletiag  the  execution  of  Al. 


{**) 


(45) 


(46) 


It  k  a  simpk  matter  to  compote  realkations  of  G  cotraspoadisg  to 
each  of  the  coBstraiaedHtroctarc  dynamic  ontpat  feedbach  problems 
cataloged  in  Tabk  1  naing  Thm.  4.4.  To  do  thk  ws  simpiy  sobetitate 
the  data  for  K  ia  Tabk  2  into  (48).  For  the  convtakace  of  the  reader 
the  rcsnlts  of  tbk  aimpk  exercise  are  cataloged  in  Tabk  3. 

In  order  to  address  the  itsne  eS  the  nuqtenssa  of  G  aad  therely 
compkte  onr  stndy  of  Q3  we  derive  the  IbOowiaf  resait  from  That.  4.3: 

Thcoreaa  4.S  Dtnclt  Ikt  Tulixattea  of  G  firta  ia  (48)  **  ii  (35). 
Uaitr  thk  ceadilioH,  calf  3a,  Ca,  Dia,  aad  Dai  ia  Ait  naliiatiea  art 
not  nxffnsfy  iptei/Ud,  aad  three  tnetriees  tatitff  tktfoUewiaf  nUXoat: 

fo  /i(i)i_ra(o)  mufo  fi,  , 

U  oJlhw  «wj  It{c)  *(0)jjl*s 

DiaDai «  dm  [f (i)  -  f (O))*,.  (SO) 

The  sigxiScance  of  Thm.  45  k  that  it  shows  that  tss  sbgalirity 
stmctaincf  <7  rslativa  to  ths  optimal  static  octpnt  feedbach  peobkmk 
eseeatiaDy  caiqneiy  detenniaed,  and  sqnhrakat  to  the  stignlarity  atrae» 
tart  of  g  relative  to  the  optimal  constraiasd-strncrarc  dynamic  octpnt 
fsedbsdc  peobkna.  As  sach,  ws  coachds  th.t  ths  Mctign  opportaakf 
that  exkls  as  choorag  X  in  Al  can  aeither  be  exploited  or  mkos^ 
to  faadameauBy  efect  A3  cr  alter  the  aaewsr  to  Q2.  For  all  pracn> 
cal  pirpoeee  then,  ht  a  gtvta  problem  aQ  poesibk  manifastatiois  of  the 
redaction  procednri  a»  eeMatkliy  eqnrraleat. 


4.3  Implementation 

la  thii  Mctioo  Q4  ud  Q5  art  aoiwcrtd.  Wt  bcfin  by  asiwerinf  Q4: 
Tbtorttn  4.8  Sufpotc  (38)  tad  (37)  koU.  Unitr  tkit  eondition, 


(SI) 


Proof:  To  prove  the  theorem  we  write: 


r(K)-jo<t(X)  -  go(JCoif) 

- 1' 

- 1'  ''){"(‘*[ii 

-  l'  !il}[o] 

»  (g*lC]oK  (55) 

-  GoX-r.(X), 


nttnf  Fact  2.3  to  write  (52)  and  (S5),  the  definition  of  the  ttar  product 
and  the  propertiee  of  the  empty  matrix  to  write  (53),  and  Fact  2.1  to 
write  (54)... 

Note  that  in  the  proof  of  Thm.  4.8  we  have  actually  shown  the  more 
general  reeult  that  the  compoeition  of  two  linear  fractional  tranafor- 
mationa  can  be  rewritten  as  a  single  linear  fractional  transformation 
through  the  use  of  the  ttar  product  (15|. 

Having  answered  Q4,  we  now  answer  Q6. 


Theorem  4.T  5«ppois  K  it  giesn,  and  (Ufin*  inUmal  itahlitf  of  ikt 
inisreonnsctton  of  K  with  G  in  Urmt  of  tk*  oioU'tfoet  rtalioation  of 
G  fioen  in  (4^)*  Under  ikeet  eonditione,  n(JC)  ie  inUmoltg  eloHimnt 
for  j  if  and  onlf  if  K  i»  inUmallf  itahilinnj  for  G, 


Proof:  To  prove  the  theorem  we  simply  use  Facts  2.2  and  21  to  write: 


[  1- 

L  J 

1  «  J 

(58) 


in  which  ease  the  theorem  clearly  holds. . . 

Having  answered  Ql,  Q2,  Q4,  and  Q6,  we  have  established  the  va¬ 
lidity  of  the  reduction  procedure  and  also  developed  systematic  methods 
for  its  exscntion.  As  such,  the  stage  is  now  set  for  a  thorough  study  of 
Q3,  and  this  study  will  commence  in  Part  2  of  this  paper  |3). 


5  Conclusions 

In  this  paper  the  optimal  constrained-structure  dynamic  output  feed¬ 
back  problem  has  been  formulated  in  general  terms,  and  a  general 
msth^  developed  for  reducing  optimal  constrained-structure  dynamic 
output  feedbag  problems  to  optimal  static  output  feedback  problems. 
This  reduction  procedure  was  concretely  illustrated  for  nine  special  cases 
of  the  general  optimal  constrained-structure  dynamic  output  feedback 
problem.  Furthermore,  it  was  shown  in  some  detail  how  one  of  these 
special  eases  could  be  us^  to  constrain  the  dynamie-structure-of  the 
controller  to  a  F-I  form. 

We  expect  that  the  reader  will  have  little  difSenlty  formulating  his 
own  particular  problems  of  interest  (e.f.,  lead/lag  compensator  design 
problems)  in  terms  of  one  of  the  nine  special  eases  of  the  general  opti¬ 
mal  eottstruned-stmeture  dynamic  output  feedback  problem  considered 
here.  We  also  expect  that  the  reader  will  have  little  difficulty  formu- 
.lating  special  cases  tailored  to  suit  his  tastes  if  the  need  arises  to  do 
so. 

Of  conns,  in  this  paper  we  have  in  no  way  solved  the  optimal 
constraiaed-etmeture  dynamic  output  feedback  problem;  rather,  we 

'Since  K  is  stalk,  inlenal  stafcUlly  bate  maaaa  th::!  so  decays  to  sen  from  all 
iaillal  cooditkos  aodar  aaso  iapul  eaedllioao  la  tba  clcaad-loop  syttani. 


have  only  shown  how  to  reduce  this  problem  to  the  optimal  static  out¬ 
put  feedback  problem.  However,  in  Part  2  of  this  series  of  p^en  a  gen¬ 
ial  theory  of  optimal  static  output  feedback  compensation  is  developed 
which,  when  combined  with  the  numerical  methods  presented  in  Part 
3  of  this  series  of  pspen,  should  allow  optimal  constrained-structure 
dynamic  output  fs^back  compensation  problems  to  be  systematically 
solved  in  applications. 

We  feel  sbongly  that  the  availability  of  a  systematic,  procedure  for 
solving  optimal  constrained-structure  dynamic  ontpnt  feedback  prob¬ 
lems  will  do  much  to  bridge  the  gap  that  currently  axis. ,  1  ctween  control 
theory  and  control  practice.  In  particular,  we  export  that  a.methodol- 
ogy  of  this  sort  will  enable  a  significant  mtegration  of  the  control  law 
design  and  implemsatatiott  processes  [13].  To  give  but  one  piece  of  ev¬ 
idence  in  support  of  this  claim,  consider  the  problem  of  implementing 
a  full-envelope  control  law  for  a  nonlinear  process  |l4j.  Typically,  fin- 
ear  controllers  are  designed  at  various  operating  points  and  then  gain- 
Khednled  in  order  to  achieve  fsU-envelope  operation.  In  this  process 
the  dynamics. of  the  linear  controUers  dasignsd  at  each  operating  point 
am  usually  constrained  apriori  to  a  fixed  form  (s.g.,  a  P-I  structure), 
and  then  the  ‘gains*  of  the  resulting  linear 'controllers  am  appropriately 
scheduled  (i.s.,  proportional  and  integral  gain  schedules).  The  process  of 
designing  the  constrained-stmetum  control  lasrs  at  each  operating  point 
would,  cf  course,  be  facilitated  by  linear  control  law  design  methodolo¬ 
gies  of  tbs  type  described  above.  Indeed,  in  the  notation  of  Sec.  3,  the 
controller  'gain*  would  be  nothing  mom  than  K,  and  the  gain-schedule 
would  amount  to  nothing  more  than  a  schedule  of  K\  ^is  situation 
should  be  contrasted  to  the  situation  lor  most  currently  avmlable  linear 
control  law  design  methodologies,  wherein  n  is  designed,  instead  of  K, 
subject  to  no  constraints  on  its  dynamic  stmetum.  In  this  case  it  is  often 
impossible  to  formulate  a  gain-schadnle,  as  the  dynamic  structures  of 
controllem  designed  at  dilfsmnt  operating  points  can  vary  significantly, 
instead,  one  has  no  choice  but  to  formulate  a  *«-schcdttle*,  and  this  is 
at  best  a  difficult  proposition  for  rather  obvious  masons. 
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Minimal  Complexity  Control  Law  Synthesis,  Part  2: 
Problem  Solution  via  Hj/Heo  Optimal  Static  Output  Feedback* 

D.S.  Bematemt  W.M.  C.N.  Nett§ 


Abitract 

In  part  1  of  thli  two-part  paper  |lj  it  wai  ihown  that  a  large 
claM  of  fixed-structure  control  laws  can  be  recast  as  static  out¬ 
put  feedback  controller*  for  a  suitably  modified  plant.  Accord- 
uiglyi  develop  here  a  comprehensive  theory  for  designing  static 
output  feedback  controllers.  Our  results  go  beyond  earlier  work 
by  addressing  both  Hj  and  £[„  performance  criteria  and  by  ac¬ 
counting  fully  for  all  of  the  smgularities  in  the  problem  formula¬ 
tion.  The  results  are  applied  to  the  fixed-order  problem  (FoP) 
[l]  to  obtain  a  major  unification  of  prior  results,  namely:  the 
Bemstein-Haddad  E3/H00  fixed-order  dynamic  compensator  the¬ 
ory,  the  Glover-Doyle  full-order  Hoo  dynamic  compensator  theory*, 
the  Hyland-Benutein  Ha  fixed-order  dynamic  compensator  (opti¬ 
mal  projection)  theory,  and  the  classical  LQG  theory, 

1.  Introduction 

As  discussed  in  part  1  of  this  tw>part  paper  [l|,  it  is  often 
desirable  in  practice  to  design  controller*  of  minimal  compexity 
while  meeting  all  other  design  specificatons.  The  principal  con¬ 
tribution  of  |l]  was  the  development  of  a  systematic  methodology 
for  recasting  a  large  class  of  constrained  structure  control  laws  as 
static  output  feedback  design  problems.  This  formulation  includes 
such  practical  problems  u  the  fixed-order  problem  in  which  only 
the  comperuator  order  is  prespecified  [2,3]  and  the  fixed  dynam¬ 
ics/controls  problem  (FDCP)  in  which  the  compensator  pole*  are 
specified  a  priori. 

The  purpose  of  the  present  paper  is  to  construct  a  general 
theory  of  static  output  feedback  controller  design  which  operates 
within  the  framework  developed  in  (ij.  The  theory  of  static  output 
feedback  developed  herein  fuUy  encompasses  the  prior  literature 
|4-12|  on  static  output  feedback.  However,  we  go  beyond  this  lit¬ 
erature  in  two  principal  ways.  First,  we  consider  not  only  the 
usual  H*  performance  measure  but  also  an  Hoo  criterion  to  per¬ 
mit  simultaneous  consideration  of  both  Hj  and  Hoo  design  aspects. 
This  formulation  thus  permit*  the  treatment  of  loop  shaping  and 
unstructured  uncertainty  as  well  as  rms  specifications.  The  Hoo 
results  are  in  the  vein  of  recent  Riccati  equation  solutions  [13-17], 
while  the  combined  Hj/Hgo  theory  was  developed  in  [18,19). 

The  second  extension  of  static  output  feedback  theory  devel¬ 
oped  herein  involves  a  complete  treatment  of  all  singularities  arising 
within  the  various  feedback  paths.  In  the  usual  setting  [4-11],  the 
measurements  are  assumed  to  be  noise  free  while  the  control*  are 
weighted.  Hence  this  feedback  path  is  partially  singular.  The  dual 
path  involving  noisy  measurement*  and  unweighted  controls  can 
be  treated  in  a  similar  manner  (see  [12|).  The  totally  singular  path 
involvmg  nonnoisy  measurements  and  unweighted  controls  is  also 
included  in  this  paper.  As  will  be  seen,  this  path  is  the  key  feature 
which  allows  us  to  address  several  of  the  problems  defined  in  [l] 
including  the  fixed-order  problem.  The  inclusion  of  the  totally  sin¬ 
gular  path  also  allows  us  to  make  connections  with  the  literatur'? 
on  singular  control  theory  [20-30]  as  well  as  singular  estimation 
theory  [37-41].  The  authors  are  particnlarly  indebted  to  Profes¬ 
sor  Y.  Halevi  whose  expertise  in  singular  problem*  [34,36,40,41] 

*  This  paper  sppssn  in  the  PrxKssdinn  of  ths  1U9  Amirican  Control 
Conference  and  has  baen  submitted  for  pubUcation  in  the  IEEE  IHnsactions 
on  Automatic  Control.  The  erork  of  the  flret  and  aecond  authors  on  this  paper 
was  supported  by  the  Air  Force  Office  of  Scisntifle  Research  under  contract 
FS9630.89.C-0011  and  by  the  Harris  Corporation  Government  Aerospace  Sys¬ 
tems  Division.  The  work  of  the  third  author  on  this  paper  wu  supported  by 
the  GE  Corporate  Research  and  Development  Center. 

1  Stall  Ensinter, 'Government  Aerospace  Systems  Div'isioo,  Hanis  Corpo¬ 
ration,  Mail  Stop  Meiboume,  Florida  3M0J,  (407)'7M-J1«. 

^  Assistant  Pmfeecor,  Department  of  Mechanical  and  Aerospace  Enfineer- 
ln{,  Florida  Institute  of  Technolofy,  Melbourne,  Florida  33901,  (107)  788-8000, 
Extension  7741. 

^  Research  Enfineer,  Control  Syi'tems  Laboratory,  GB  Corporate  Research 
and  Development,  Bulldinc  KW,  Rccm  D2I9,  P.O.  Boor  8,  Scnsnectady,  New 
York  12301,  (618)  387-6839. 


bad  8  direct  impact  on  the  present  work.  fVirtber  exploration  of 
the  singular  aspects  of  the  static  output  feedback  problem  will  be 
explored  in  future  papers. 

To  demonstrate  the  utility  of  our  approach  we  apply  it  to  one 
of  the  problems  considered  in  [l],  namely  the  fixed-order  problem, 
to  obtain  several  results  on  dynamic  compensator  design.  In'a  se¬ 
ries  of  specialisations,  we  obtain  the  Bemstein-Haddad  Hj/Hoo 
fixed-order  dynamic  compensator  theory  ]18,19],  the  Glover-Doyle 
full-order  Hn  dynamic  compensator  theory  [IS],  the  Hyland- 
Bemstein  Hj  fixed-order  dynamic  compensator  (optimal  projec¬ 
tion)  theory  [3],  and  the  classical  LQG  theory. 

One  important  ramification  of  the  reduction  to  static  output 
feedback  developed  in  [l]  is  that  it  refocuses  attention  on  the  prob¬ 
lem  of  stabilisation  via  static  output  feedback  [42-49].  Although 
a  complete  solution  to  this  longstanding  problem  is  not  yet  avail¬ 
able,  it  is  clear  from  the  results  in  [l]  that  a  solution  to  the  static 
output  feedback  problem  would  effectively  provide  a  solution  to  a 
broad  class  of  constrained  structure  stabilisation  problem*  such  as 
stabilisation  via  reduced-order  dynamic  compensation  ([50,51]). 


Notation. 

IR,  IR’’’*',  IR'  real  numbers,  r  X  s  real  matrices,  IR’’’^* 

^ri  ( )^i  tr  r  X  r  identity,  transpose,  trace 

®>  ®  Kronecker  product,  Kronecker  sum 

n,  m,  ms,  i,  £s,  d,  q,  q„  positive  integers 
X,  u.  Us,  y.  Vs,  *3,  Zoo  n,  m,  ms,  f,  fs,  q,  gog-dimensional  vectors 
<"(')  d-dimensional  disturbance  signal 

A,B,Bs,C,C3,  nx  r»,>»xm,nxms,f  Xn,fsXn, 

Kpi  Kx),  K3  m  X  fs,  ms  X  8,  ms  X  fs  matrices, 

Bi,D3,Bi,E2  nX  djtsX  d,qxn,q  X  m  matrices 

Vi,  Via,  Vj  DiDj,  DiDj,  D3DJ,  Vj,  >  0 

Ef^B3f  B2B31  Bs  ^  0 

Ao  A  +  BKsPCs  +  BsKsO  +  BsKoOKpC 

A,  A  Ao  +  BsKsCs,  A  +  BKC 

^  Bi  -i-  BsK^D3f  El  -f-  E3KC3 

R  Ri+Ri3KCs  +  (KCs)'^Rj3-¥[KCs)'^R3KC3 

V  Vi+  Vi3[BsKx,)'^  +  BsKoV^^  +  BsKoV3{BsKd)'^ 

Bloat  B3001  Eoa,  B3003  ?oo  X  ",  goo  X  m,  goo  xd,q„  X  ms  matrices 
K  ^  /«.  -  T^B„El,  U  -  i-^BE,Eoo 

Vico,  Viseo,  V300  DiN-^Dj,  DiN-^Bj,  D3N-^DJ 
Roioo,R<nco,Rioo,  BlM-^Ei„,ElM-^E3oo,B[^M-^Eio, 
Rlloo.Rcoo  ^coM-^B3oo,B^ooM-^^oc 

v„  Vio,  -1-  V,3oo  (Hs^d)’’  +  BsKdV^^„  -f  BslfoVaoo  (BsKd)'^ 

Boo  Bico  +  B300BCS 


•^loo  £2oM”*^oo  =  '^Iso  +  BoiceKCs 

^  =  Rioo  +  RiiooKCs 

_  +(ifCs)Ti?S„  +  {jrCs)»JZ3„^C'3 

3.  Underlylsg  Formulation:  Optimal  Hi/Hoo 
'  Static  Output  Feedbaclc 

In  thii  lection  we  present  the  Hi/Hco  Static  Output  Feedback 
Problem  which  formi  the  baiii  for  addreMing  all  of  the  conitraiaed 
structure  control  laws  considered  in  (l|. 

H]/Hoa  Static  Output  Feedback  Problem.  Consider  the 
system 

i(t)  =  Ax{t)  +  Bu[t)  +  SsUsW  +  A“Wi  ..  *  e  [0,  oo),  (2.1) 


y(t)  =  Cx(t)  +  Du(t)  +  X>3to(t),  (2.2) 

ysCO  =  C3x(t)  (2.3) 

with  feedback  law 

us(t)  =  A^sys(t)  +  ^foyWi  (2*<) 

u(t)  =  Kpyslt),  (2.6) 

and  performance  variablei 

W  =  +  ^“  W>  (2.6) 

»oo  (0  =  •BlooX{t)  +  i^oa«i(t)  +  £'«u)(t).  (2.7) 


Then  determine  fuine  (Xsi  Rdm  ffp)  satiiQring  the  following  design 
criteria: 

i)  the  closed-loop  system  (2.1)r(2.S)  is  asymptotically  sta¬ 
ble,  i.e.,  A  is  asymptotically  stable; 

ii)  foi^  specified  7  >  0,  the  qoa^d  transfer  function 

ir(a)  =  ^00  (*/»  -A)-^£>  +  E„  (2.8) 

from'Ui(')  to  rco(‘]  latisfies  the  Hoo  norm  constraint 

l|ir(a)||«<'r!  (2.9) 

iii)  the  Hs  norm  of  the  9  x  d  transfer  function 

G(,)^E[tIn-A)-^D  (2.10) 

is  minimised,  Le.,  minimise 

_ _  _  (2.11) 

Remiurk  3.1.  Using  Farseval’s  theorem  it  is  easy  to  show  I 
that  the  Hs  performance  criterion  (2.11)  is  equivalent  to  the  mm'e 
familiar  expression  involving  an  averaged  integral,  Le., 

J(Jf3,/fD,ifp)  =,lim  jE{jf‘*’f(.)R,*(s)  ^2.12) 

2l'^(s)f?l3U(s)  +u'*'(s)if3u(f)  ds). 

with  u)(-)  interpreted  as  standard  white  noise. 

Remark  3.3.  Note  that  the  controller  architecture  is  quite 
general  in  that  it  includes  three  distinctly  dififerent  types  loops. 
The  first  type  involves  feedins-  back  nonnoisy  measurements  to 
weighted  controls.  This  is  the  standard  setting  in  the  optimal 
output-feedback  literature  ((4-12])i  In  addition,  we  include  the 
dual  situation  which  involves  feedmg  back  noisy  measurements  to 
unweighted  controls  (see  [12]).  The  third  feedback  loop  involves 
feeding  back  nonnoisy  measurements  to  unweighted  controls  which 
corresponds  to  a  singular  static  output  feedback  contrul  problem. 

Several  remarks  are  in  order  to  clarily  the  problem  state¬ 
ment  and  Figure  1.  Firit  note  that  the  dkect  transmission  be¬ 
tween  disturbances  u(-)  and  Hj  performance  variables  s^(■)  is  as¬ 
sumed  -to  be  sero.  This  assumption  ent^  no  loss  of  generality 
since  if  this  term  were  noniero,  then  the  transfer  function  between 
u)(-)  and  X3(-)  would  be  nonstrictly  proper  yielding  an  infinite  H3 
cost. 


Next  note  that  the  input  and  measurement  matrices  of  the 
plant  are  partitioned  as  |B  B3I  and  |  >  respectively.  .The  par¬ 
titioning  of  vhe  measurements  emphuises  that  the^measurements 
y(-)  are  noisy  (since  DjDj  >  0)  while  the  measurements  ys(-)  are 
nonnoisy.  The  pahitioning  of  the  controls  reSecti  the  fact  that  the 
controls  U3(.)  are  unweighted  in  the  H3  cost  while  u(-)  may  be 
weighted.  Note  that  we  only  assume  >  0  since,  as  will  be 

seen,  the  Hoo  weighting  £300  can  compensate  for  the  singularity 
in  E2E2.  The  controls  u(-)  can  be  distinguished  as  those  controls 
to  which  the  noisy  measurements  are  not  fed  back.  Because  of 
the  control  and  measurement  partitioning,  there  are  four  possible 
feedback  paths.  However,  in  order  for  the  H3  cost  to  be  finite 
we  require' that  the  direct  transmission  in  the  controller  between 
y(-)  and  u(-)  be  sero  (see  the  (2,2)  block  of  the  feedback  gain  ma¬ 
trix).  Finally,  there  are  several  elements  in  Figure  1  which  will  not 
be  considered  in  the  present  paper.  Specifically,  BiooS  entails  a 
direct  transmission  path  between  measurement  noise  and  the  Boo 
performance  variables  Soa(‘)-  path,  however,  leads  to  com¬ 
plexities  in  the  optimisation  procedure  wluch  are  deferred  to  a  later 
treatment.  Hence  we  set  £3003  =  0.  Note  that  we  do  allo«'  a'direct 
transmission  term  Eo»  between  disturbances  and  Hoo  perfcrmance 
variables.  In  addition,  we  set  D12  =  0,^21  —  0,  and  Vg  =  0 
since  these  lead  to  algebraic  loops  (except  when  D  =  0  and  Ks 
is  omitted,  in  which  cue  Es  does  not  entail  an  algebraic  loop). 
In  the  present  paper,  however,  we  shall  only  consider  the  direct 
feedthnungh  term  D. 

Although  the  Ha/Hoo  Static  Output  Feedback  Problem  illus¬ 
trated  in  Figure  1  is  quite  general,  special  cases  can  readily  be 
discerned.  For  example,  if  either  y,  ys,  u,  or  us  is  absent,  then  cor¬ 
responding  feedback  gains  can  also  bs  usumed  to  be  absent.  In 
most  cues  the  optimality  conditions  given  below  specialise  in  an 
obvious  way.  The  on^  case  requiring  some  caution  is  that  in  which 
y,  y3,  u,  and  U3  are  all  present  so  that  Kp- and  Kd  are  required  but 
Ks  is  not  utilised.  Specialisations  to  this  case  must  thus  be  noted 
separately. 

Note  that  the  closed-loop  system  (2.1)-(2.5)  can  be  written  u 
x({)  =  Ax(t)  H-  3w(t)  (2.13) 

and  that  (2.11),  or  equivalently  (2.12),  becomes 

£0,  ifp)  =  ,lim  IB  [i'r(t)fi*(t)]  .  (2.141 

Note  that  the  problem  statement  involves  both-Hs  and  Hoo 
performance  weights.  In  particular,  the  matrices  and  R3  are 
the  H3  weights  for  the  state  and  control  variables.  Uimg  the  H3 
performance  variables  (2.6)  the  cost  (2.11)  can  be  written  u 

J(Ks, Kd.  Kp)  =  lim  IE|^(t)x3(<)I-  (2-15) 

For  convenience  we  thus  define  Ri  =  K^Ei  and  R2  =  £^£3  which 
appear  in  subsequent  expreuions.  Note  that  R12  =  .^£3  is  an  Hs 
cross-weighting  term  which  is  included  for  greater  duign  fiembility. 

For  the  Hoo  performance  constraint,  the  transfer  function  (2.8) 
involves  weighting  matrices  Etoo,  £3001  and  E„  for  the  state,  con¬ 
trol,  and  disturbance  variables.  The  matrices  Rsoa  = 

£300  are  thus  the  Hoo  counterparts  of  the  Hs  weights  Ri  and  £3. 
Here  Af  =  Jgoo  -  7"®£oo£S'  arkes  due  to  the  feedthrough  term  to . 
the  Hoo  performance  criterion.  As  in  the  Hs  case  we  allow  an  Hoo 
crow-weighting  term  £1300  =  -^nA^'^-^oo-  Finally,  the  dual  de¬ 
sign  feature  of  plant  disturbance  and  sensor  noise  correlation  is 
also  pemutted.  As  in  [18],  the  disturbances  w(-)  are  interpreted  as 
white  noise  signals  within  tbs  context  of  Hs  optimality  while,  for 
the  purpose  of  Hoo  attenuation,  the  very  same  disturbance  signals 
have  the  alternative  interpretation  of  deterministic  £3  unit  norm 
functions.  , 

Before  continuing,  it  is  useful  to  note  that  if  A  is  asymptoti- 
'cally  stable  for  a  given  controller  (K3,Kd,Kp)  then  the  Hs  ]^r- 
-formance  (2.11)  is  given  by 

J(K3,Kd,Kp)=  trQR, 


(2.16) 


wheTO  the  ateedy-ftete  clo«ed-loop  ttate  covariuee’de&sed  by 

(2.17) 

satufief  the  n  X  n  algebraic  Lyapnaov  eqaation 

0  =  A$  +  ^A'^+^.  .  (2.18) 

Remark  3.3.  Uiing  (2,16)  and  (2.18)  it  can  be  ihown  that  the 
Hj  coat  criterion  (2.11)  can  be  written  in  terma  of  the  Xg  norm 
of  the  impnlie  reaponie  of  the  cloaed-loop  system.  Specifically, 
writing  Q  satisfying  (2.18)  as 


Theorem  3.1.  Suppose  there  exist  nXn  nonnegativa  definite 
matrices  Q,  P  satisfying 

0  =  (.4  +  r ’3Ro!»)<?  +  Q(A  +  'i-^DRoicof 

+  7-=QR=.<?  +  Koo,  _  (3.1) 

0  =  (A  +  P 

+  P{A  +  +  7"’Q.S«)  +  a,  (3.2) 

and 

Rj  ®  OsQCg  +  'f'^Rioa  ®  ^sQPQ^s  ^  (3.3) 

“  CsQCj>0,  BjPBs>0,  (3.4),  (3.5) 


Jo 


(2.1d)  becomes 

J[Ks,Ko.Kf)=  /‘”|l£e-*’*5lljdt, 

Jo 

where  ||  •  ||r  denotes  the  Frobenins  matrix  norm.  This  stochastic 
petformancs  measure  can  thus  also  be  pven  a  deterministic  inter¬ 
pretation  by  ktting  w(t)  denote  impulses  at  t »  0. 

The  key  step  in  enforcing  the  distnrbaace  attennatioa  con¬ 
straint  (2.9)  is  to  replace  the  algebraic  Lyapnnov  equation  (2.18) 
by  an  algebraic  Riccati  equation  which  overbounds  the  ckeed-loop  , 
steady-state  covariance. 

I 

Lemma  3.1.  Let  (RsiRdiAf)  lx  rvcn  and  assume  there 
exists  an  n  X  n  nonnegative-definite  matrix  Q  satisfying 

q=aq+qX'^+ + V. 

(2.19) 

(2.20) 

(2.21) 

(2.22) 

(2.23) 


(2.24) 

(2.25) 


Then 

(A,  £>)  b  stabilbable 

if  and  only  if 

A  b  asymptotically  stable. 

In  thb  case. 

IW»)1I-57 

and 

g<g. 

Consequently, 

AKs.Kd.Kp)  <  J(K3,Kd.Kp,Q), 

where 

JIK3,Kd.Kp,Q)^  trQA. 

Proof.  See  (18|.  □ 

Remark  3.4.  An  equivalent  form  of  (2.19)  is  given  by 


0  =  (A  +  ^~^D^la,)Q  +  <3(A  +  7“^55oic3)^ 

+  1-^Q^Q  +  V„. 


(2.28) 


Lemma  2.1  shows  that  replacing  (2.18)  by  (2.10)  enforces  tho 
Hos  disturbance  atUauation  constraihi  and  yiel^  an  upper  bound 
for  the  Ha  performance  criterion.  That  is,  given  a,  controller 
K<f.KD,Kr  for  which  there  exists  a  nonnegathre-definite  solu¬ 
tion  to  (2.19),  the  actual  Hj  performance  J{Xs,Ko,Kp)  of  the 
controller  is  guaranteed  to  be  ho  worse  then  the  bound  given  by 
J{K3,KoiKrtQ).  Hence,  as  in  |18]  wu  interpret  J{Ks,Ko,Xr, 
Q)  ss  an  auxUiaiy  cost  and  dstermina  {Ka,Kj)tXr,Q)  which  min¬ 
imises  J(Ks,Kx>,Kr,Q),  and  thus  provides  an-optimiscd^bound 
for  the  actual  Hj  perfonnance  J(Xs>RbiRr)  while  enforcing  the 
disturbance  attenuation  constraint  (2.22). 

3.  Sufficient  Conditions  for  Hg.  Disturbance  Attenuation 

In  this  section  we  state  sufficient  conditions  for  charKterising 
static  ontpnt  feedback  controUss  guaranteeing  closed-loop  stabil¬ 
ity,  constrained  Hgg  disturbance  attenuation,  and  an  optimised  Hj 
performance  bound. 


where  [Ks,  Ko,Kp)  are  given  by 

Ka  =  -[BlPBs)-^BjP[{Ao  +  'r-^DBoico)Q  +  <3(^ 

+  7-*3Roico)’‘+7-’Q^<?  +  VcoICj(C3g£7j)-S  (3.6) 

Kd  =  —{BsPBs)~^BgP[QC'^  +  Fi3»  +7  ^gRjioo^Jl^sooi 
RaKfCaQCj  +  n-^R2„KpCaQPQCj  (3.7) 

=  -[B’^P  +  B:J,+n-^RT,„QP+',-^liSa„DjP\Qdi{3.i) 

Then  (A,  D)  b  stabilbable  if  and  only  if  A  b  asymptotically  stable. 

In  tbb  case,  the  closed-loop  transfer  fiincticin  H'(s)  satbfies  the  Hm 
dbturbance  attenuation  constraint 

0F(»)!U<7.  (3-9) 

and  the  Ha  performance  criterion  J(Ka,Ko,Xp)  satbfies  the 
•bound 

l|C(*)ll3<  (3-10) 

Proof.  See  the  journal  version  ofthb  paper.  □ 

Theorem  3.1  presents  snfficbnt  conditions  for  designing  static 
output  feedback  controllers  with  a'  preepecified  constraint  on  the 
Hoe  no™  of  the  closed-loop  transfer  fnactibii.of  a  given  state- 
space  modeL  These  sufficient  conditions  comprise  a  system  of  one 
Riccati  equation  and  one  Lyapnnov  equation. 

Retxcark  3.1.  Note  that  in  order  to  obtain  explicit  expressions 
■for  the  gains  Kd  and  Ks  we  require  that  CaQCf^  and  Bj PBa  be 
positive  definite.  Unfortunately  these  conditions  cannot  be  con¬ 
firmed  until  Q  and  P  are  avaibble.  However,  it  can  be  shown  that 
if  CsVi£^  b  positive  definite  then  bo  b  CaQCg,  and  if  BjRiBs 
b  positive  definite  then  so  b  BjPBs-  These  results  follow  from  au 
analysb  of' the  integral  formulas  for  the  Gramians  Q  and  P.  The 
interesting  aspect  of  these  conditions  b  that  they  correspond  to 
first-order  singularity  hypotheses  arbing  in  the  singular  estimation 
and  control  literature  |20-4l|. 

Remark  3.3.  It  can  be  shown  that  the  optimality  condition 
corresponding  to  the  gain  Ka  b  given  by 

0  =  CaQPBa.  (3.11)  . 

Condition  (3.11)  provides  the  key  to  showing  the  relationship  be¬ 
tween  the  static  output  feedback  problem  and  the  fixed-order  dy¬ 
namic  compensation  problem  treated  in  Section  5. 

Remark  3.3.  If  the  singular  path  b  absent,  Le.,  the  gain  Ka 
b  not  utilbed,  then  the  expressions  (3.7)  and  (3.8)  for  Ks  and  Kp 
should  be  replaced  by 

Kd  =  (BjPJ53)-*BjP(gcT  -1-  V^.30,  ,3 

+  7~^QRoico'^3 +7  ^Q^‘KpDjjVjg^, 

RaJfpCsgcJ  +  7-^Ba„KpCaQPQCj 

=  -[B'^P  +  Rja  +  7~^Ruo>QP  (3-13) 

+7-^J^,^DjP+7-^liS2„DjKSBjP\(3Cj. 

where  Q,P  satbfy  (3.1)  and  (3.2)  respectively  with  A  replaced  by 
Ao. 

Remark  3.4.  Note  that  if  Rj  =  oPAa  and  Rjoa  =  (PAa,- 
where  o  and  P  are  real  numbers  such  that  a*  -h  >  0  and  Aa  6 


Qj^tnxm  po«itiv«  definite,  the  gain  expreeeion  (3.8)  for  Kp  aim* 
plifiee  to 

jfp  =-ilj‘p«,QC7j(a’CsQCj+7-='/J>crsQP<3Cj)-‘.  (3.14) 
where 

Peo,  =  B^’P  +  Bj,  +  ^-’BFao<,<^P  +  T*Bm«.I>?P.  (3.15) 

4.  Standard  Output  Feedback 

To  draw  eonnectione  with  the  standard  static  output  feedback 
literature,  a  series  of  specialisations  of  Theorem  3.1  are  now  given. 
First,  aa  in  Remark  3.4  we  let  Ba  =  and  Bjoo  =  0*^-  Next, 
we  assume  that  Kg  =  0,  Ko  =  0  so  that  only  nonnoisy  measure* 
ments  are  fed  back  to  weighted  controls  which  corresponds  to  the 
standard  output  feedback  setting. 

Case  1:  Hj/Hoo  Standard  Static  Output  Feedback 
Problem.  First,  we  state  the  standard  static  output  feedback 
problem  with  Bj  =  and  Bjoa  =  0^62-  lu  this  case,  (3.8) 
becomes 

Kr  =  -Aj-*P.«gCj(a’<7sQCf  +7-»/l’Cs<3PgC’J)-‘,  (4.1) 

with  Q,  P  given  by 

0  =  (ii + T’Bi  Aoi»)g  +  g(A  + 

+  7-’giLQ  +  Vi«,  (4.2) 

0  =  (A+7-’Bi^i„  +7-’gB»)‘fp 

+  P(A  +  if-*BiBbi»  +  7-*gB»)  +  B.  (4.3) 

Considerable  simplification  is  further  achieved  by  deleting  the  di¬ 
rect  feedthrough  terra  to  the  Hw  performance,  ie.,  =  0.  In 
this  case 

Kv  =  -tq^P,^s{<^qcJ+'r^0*Qpqcfi) 

(a’CagcJ+i-’^’CjgpgcD-s  (4.4) 

0  =  (A  -  Btq^P^Sv^  -  7-’/S*gBuiij‘pKeB»'«)g 

+  g(A  -  BAj ‘P.«Si/„  - 7"’^’gBi,Aj-*P«,5y»)T  (4.5) 

+ 7"^gBio,g + r^P'^QuZs^p'Lki^p.^su^Q + vie,, 

0  =  (A-hi-’giBi-,, 

-  ^’‘'2^iB’'p7„Ar‘p.«t'«,i)^p 

-H  P(A +7-»giBi„  -  ^Visfpi,A3-*B5, 

-  /J’*'Xx‘S'"PjL^"‘P.c.t'»|) + Bj  -  B’‘P^A,-»P«,B 


(4.6) 

where 

B4(aV,-b7-’/>’gP)-\ 

(4.7) 

t'- = (a’gcj  -b7-’/i’gpgcj)(a»csgcS‘ 

(4.8) 

+7-’^’c'sgpgcj)-»Cs, 

and 

^ool.  ”  ■“  Koo" 

(4.9) 

Note  that  v^=Va,»o  that  t/oo  is  a  projection. 

Case  2:  Hi/Ho,  Full-State  Feedback  Problem.  Next  we 
specialise  the  results  of  Case  1  to  the  full  state  feedback  problem. 
For  simplicity  we  assume  Bia,  Ri^eo  ■  and  £«  arc  sero  and  Cs  =  In 
so  that  Vat  =  In  and  Vati.  =  0.  In  this  case 

Kr  =  -A^^B'^PS,  (4.10) 

with  g,  P  fivsn  by 

0  =  (A  -  EPS)Q  +  g(A  -  EPSf  +  ^-^QRl„Q 

+7-a^»gsTprPSg-bVie.,  (4.11) 

0  =  (A + 7"^gBi,.)’’P  -1-  P(A  -b  7"’gBi») 

+  Ri-S'^PEPS,  (4.12) 

where  r  =  BAj‘BT. 


Beinark  4.1.  It  is  interesting  to  nots^that  even  in  the  full- 
state  feedback  case '  the  Hj/Ho,  problem  involves  two  coupled 
equations,  one  modified  Riccati  equation  and  one  modified  Lya¬ 
punov  equation. 

Case  S;  Petersen-B^argonekar-Zhou  Ha,-Full  State 
Feedback  Theory  [13,14].  In'  this  easewe  Mmpletely  eliminate 
the  H]  aspect  in  the  design  problem  in  order  to  establish  connec¬ 
tions  between  our  approach  and  the  results  obtraed  in  [13,14|.  V/e 
completely  eliminate  the  Ha  co^ribution  ty  letting  Ri,Ri2  and  a 
(and  thus  Ba)  approach  sero.  This  as^ptotic  proeedur'  serves  to 
completely  eliminate  the  Hj  contribution  to  the  problem  so  that- 
the  resulting  setting  corresponds  to  a  pure  Heo  design  problem. 
Once  again  for  simplicity  we  set  Biaoa  sud  Em  to  sero.  In  this 
case  by  defining  a  new  variable  Z  =  7’g"^,  (4.4)  becomes 

K  =  -R^lB'^Z  (4.13) 

and  (4.5)  and  (4.6)  collapse  to 

0  =  A'^Z  +  ZA  +  Rla,+^-^ZVlZ-ZEZ,  ■  (4.14) 

which  appears  in  [13,14|. 

Came  4:  Hj  Static  Output  Feedback  Theory  [fi]..  In 
this  case  we  specialise  the  results  of  Case  1  to  the  Hi  setting. 
Specifically,  by  sufficiently  reiaxiag  the  Hm- disturbance  attenna- 
tiott  constraint,  Le.,  7  -*  00,  then  (4.4)-(4.6)  reduce  to 

/fp  =  -Ba-»P.gCj(CsgcJ)-‘,  (4.15) 

0  =  (A -  BBJ-»P,i/)g  +  g(A  -  BR^^Pavf  -b  Vi,  (4.16) 
0  =  A^’P  -b  PA  -b  Bi  -  PjBJ^P,  -b  vJPjR^^PaVx,  (4.17) 

Pa^  B^P  -b  B?,.  1.  ^  gcj(csgcj)-‘cs,  v^^  in-  V. 

This  case  corresponds  to  the  result  of  |5)  with  the  added  features 
of  correlated  plant/measorement  noise  (Vji)  and  cross  weighting 
(Bn).  Finally,  by  settbg  Cs  =  the.LQR  problem  is  recovered. 

5.  Fixed-Order  I>y&ajn!c  Compensation 

We  now  consider  the  fixed-order  problem  (FoP)  as  a  special 
case  of  the  singular  static  output  feedback  problem  considered  in 
Section  3. 

Ha/Hoe  Dynamic  Compensation  Problem.  Given  the 


iicth-order  stabilisable  and  detectable  plant 

i(t)  =  Ai(t)  -b  Bu(t)  -b  Biu«(t),  (5.1) 

y(t)  =  C*({)-bBo(t)-bBju>(t),  (5.2)= 

determine  an  iieth-order  dynamic  compensator 

*e(t)  —  Acne(t)  -b  Bey(t),  (3.3) 

u(t)  =  Cere(t),  (5.4) 


which  satisfies  the  design  criteria  (i)-(iii).  Ushg  the  results  of  Part 
1  of  this  paper  [l],  the  dynamic  output  feedback  problein  is  recast 
as  an  output  feedback  problem  of  the  form 


[mo]‘ 

0 

II 

«(<). 

0 

.0  0. 

+ 

(5.5) 

=  [S 

“(0. 

(5.6) 

with  a  static  output  feedback  control  law 

“s(t)l_rB3  ffnl  f 
i  u(t)  J  -  [Bi.  0  J  1 

V3(01 

,y(‘)']’ 

(5.7) 

Note  that  it  follows  from  (5.5)-(5.7)  that  us(t)  =  x,(t)  and  y5(()  = 
Xc(t)  so  that 

Xefs)  =  BsXo(t)  -b  Bby(t),  (5.8) 


(5.23) 


u(()  =  KfS.{t).  (5.9) 

Note  that  the  tinKclar  gain  Ks  in  the  static  problem  corresponds  to 
the  compensator  dynamics  matrix  At  while  Ko  and  correspond 
to  the  Kalman  gain  Bt  and  regulator  gain  Cf  We  rewrite  (5.5) 
and'(5.0)  as 


v(t)  =  (C7  Ol[;Wj]+lO  Ul[“jW]+2?n.n(e).  (5.11) 


»W  =  lO  ^[x.(J)^-  (S-12) 

Le.,  (2.l)-(2.3)  with  A,  B  replaced  by  o]  *  [  0  ]  ’  “*• 

Next,  as  in  Section  d  we  give  a  series  of  specialisations  of  The¬ 
orem  3.1  to  draw  connections  with- the  dyaan^  output  feedback 
literature.  Once  again  for  simplicity  in  statmg  the  main  results 
we  assume  JZj  =  and  Rata  —  ••  in,' Remark  3.4.  Thus 

using  (5.7)  with  (5.10)-(5.12)  along  “with  Theorem  3.1  we  obtain 
the  following  special  cases. 


Case  1:  Bemstclo-Haddad  Hj/Hm  Rlxed-Order  Dy¬ 
namic  Compensation  Theory  .[18,19].  TUs  case  addresses 
the  problem  of  fixed-order  dynamic  compensation,  Le.,  n«  may  be 
less  than  the  order  of  the  plantin.  As  in  [3]  this  constraint  leads 
to  an  oblique  projection  which  introduces  coupling  between  the 
operations  of  regulation  and  observation.  Specifically,  partition 
(n -b  rie)  X  (n r.*)  Q,  .P  as 


(5.13) 


so  that  (3.11)  with  <}  =  Q  and  P  =  .P  yields 


0  =  +  PiQi  (S-M) 


or,  equivalently, 


—Pa^PuQu.Qa  ^  ~  ^>*4’ 


(5.15) 


Next,  defining  P  =  — =  QuQa^  R follows  that  PCf^  — 
In,  so  that  r  =  is  idempotent,  Le.,  f*  =  Cf^rCf^r  =  Cf^P  = 
r.  This  is  precisely  the  condition  that  arises  in  fixed-order  dynamic 
compensation  theory  [3].  Next  usbg  Theorem  3.1  we  can  spedslise 
.^Si-Rdi  andRp  toobtun 

Aa  =  PlA-  Bft^^PaS  -  Q.VaiC  +  Q.V^^Dk^^PaS 

■^•'f~^[,QRloa+ BlRoiot~  OlPfOmka^PaS  (5-18) 


Bt  =  rtj.v’ii,  Ct  =  iq^PtScf^.  (s.n),  (s.is) 


Shrthermore,  algebraic  manipulation  of  (3.1)  and  (3.2)  shows 
that  Q,  P  and  P  are  given  by  (see  Theorem  6.1  of  (19)) 

0  =  [A+n-^DiRcica)Q  +  <J(A-i-7-*D;Rbi«r 

+  n-^QRi4»<t  +  Vk»  -  QaV^Ql  +  rxQtV^Qlrl,  (6-W) 
0  =  (A  -r  'j~^lQ  +  ^iRioD  +  'j~^DiPoioo  —  'T^^S'^Pj  -fta 
-h  P(A  +  ^~^[Q  +  +  l~^BiPoieo  —  Pj 

-h  Ri  -  *P.S  +  rl^Pjft^^PaSrj.,  (5.20) 

0  =  (A  -  Bk^'^PaS+n-^Q\Ri„  -  Rucof^^PtS] 

-!-7-’Di(Pbio.  -RmooAj'P.SD^ 

+  4(A  -  Bk^^PtS  +^-^Q[Rlaa  -  Riactk^^P.S] 

+  n-^DilRoi,a  -  Ro2oak;^P,S]f 
+'f~'^^{Rioa  —  Riaaok^^PtS  ~  k^Pl^^PJatt 
+  ^’S»P.ilj-‘P.S)<5  +  Q.Va-atQl  -  uQ.VSiQM,  (5.21) 

0=  (A-Q.ya»<7+7"*i>J^i«+7"*<?Bi<» 

-  l~^Q.Va~jD3Rotcoff’ + P(A  -  9.Vj«*C  •b7"’PiiJoi« 

+  7”*9a^3o*  ^aRoioo) 

-i-  S'^Pjk^^P^S  -  rJS'^Pjk^^P.STj.,  (5.22) 


rank  ($  =x  rank  P  =  rank  qP  —  n,, 

where 

5  4(aV„.fdV’<5P)"* 

r  =  <JP((5P)*,  rj.  =  /„-r. 

Qa  =  +  V„„,P.  ^  IB"^ +T^k^aaDl 

+^-^Pl,.^^Q  +  ^)\P+PI,■ 

Considerable  simplification  is  achieved  when  'VisiRta,  Riiooi 
and  Baa  aie  leto.  In  this  case  (5.16)-(5.22)  become 

At  =  P[A-QS-BPS  +  't-^QRiaa)G'^,  (527) 
Be=.-r<3C^V'a  *,  Cc  =  k;^B'^PSG'^,  (5.28),  (5.29) 


(5.24) 

(r25) 

(5.26) 


0  =  A<?-r  QA^  -}-  Vi  +  7"®QRiooQ  -  QSQ  +  riQ^grl  ,(5.30) 

0  =  (A  -h  7-*[Q  +  <51Ri»)'^P  +  P(A + 7-='IQ  +  <3lRi~) 

+  Ri  - S’^PSPS  +  rlS'^^PPPSrj.,  (5.31) 

0  =  (A  -  BPS  +  7"’<?Ri<»)<5  +  4(A  -  BPS  +  7~*<?Rio.)^ 
7“*<5(Rioo  + d’s'*^pi?ps)(5 + Qkq  -  ti.qBqt'I,  (5.32) 

0  =  (A  -  +  7“*<?Ri»)’’P+  P(A  -  (JD  +  7"=*<?Ri«) 

+  S'^PBPS-t1S'^PBPStj,,  (5.33) 

where  B  =  BH^^B"^  and  B  =  CTVa“‘C.  These  are  precisely  the 
resnlts  of  Theorem  6.1  of  [18|. 

Semnrk  5.1.  Equations  (5.10)-(5.23)  present  the  complete 
solution  to  the  fixed-order  Ha/Hoo  four  block  problem.  If  full- 
order  controllers  are  of  interest  then  set  iif  =  n,  so  that  r  = 
G  =  P  =  In  and.rj.  =  0.  In  this  case  the  last  term  in  each  of 
'(5.19)-(5.22)  can  be  deleted  and  (5.22)  becomes  auperfinous  so 
that  Theorem  4.1  of  |19|  is  recovered.  Alternatively,  if  a  'pure* 
Hca  reduced-order  eontrolUr  wiAout  an  Ha  design  aspect  is  sought, 
then  as  in  Section  4,  Cate  3,  let  the  Ha  weights  approach  sero,  Le., ' 
Pi,  Pia,  aad  a  -»  0  to  recover  Theorem  7.1  of  (19)  which  addresses 
the  ‘^nre*  Hoo~optimal  fixed-order  problem. 

Case  3.  Glover-Dcyle  Hco-EoU-Order  Dynamic  Output 
feedback  Theory  [15-17].  In  this  case  we  specialise  the  results 
of  Theorem  3.1  or,  equivalently,  the  results  of  Case  1  to  [15-17]. 
First  set  n,  =  n.  Next,  in  order  to  eliminate  the  Ha  contribution, 
let  Ri,Ri3  and  a  approach  sero.  In  this  cate  by  defining  a  new 
variable  Ya,  =7''*(<?  +  <5)”*f  (5.16)-(5.22)  become 

Ac  =  A  -  Bf^-in„(/„  -  7-’«no)-‘  -  Q,V,-atC 

+  Q.Vi^DIh„Y„,{U  -  7"’Q n.)"‘  +  7"’{[9B,o. 

+  DiRoi»  -  B,Rojo.RJiFio.(4.  -7"*<5V«.)-* 

-  QPsacoP^^Yaaail,,  -7"*<?no)"‘  "  Q.VfJtDaRoito 


+  QaV^DaPnaoP^XYaaaiTn  -  7"’<?n.)-*j  (5.34) 

Bt  =  QaV,li.  Ct  =  P^i,Yaa.[I„  -7"*Qyo.)-‘.  (5.35,5.36) 

0  =  (.4+7~®DiR|)ioo)Q  +  Q(A+7“*DiJZoioo)^ 

+  Vloa+r^QPlaaQ-Q.Val^Ql.  (5-37) 

0  =  (A  +  n-^DiRoi4.,fYaa  +  Yaa{A  +  -"’Pl^blc) 

+  +  7”’nc  Vioo V.O  -  YaatP^XYtoa,  (5.38) 

p[QY„)  <7*,  (5.39) 

no.  =  BTV„  +  7"’i^3»iJ?i'»  +  Rfaoo-  (5.<0) 

Fbither  simplification  can  be  achieved  by  setting  Vi3,Ri3ee, 

and  Eeo  to  sero  so  that(5.34)-(5.39)  become 


Ac  =  A  -  QB  -  f;yco(/„  -  7"’<3n,)-"  +^-^QPlo„[SAl) 

Bt^QC^Va'^  ‘  (5.42) 

Ct  =  -P^B-^Yta[Tn  -  l-^QYaa)-\  (5.43) 

I 

0  =  AQ  +  QA'^  +  Vi+'i-^QRitaQ-QSQ.  (6.44) 

0  =  A'^Yao  +  A  +  +  l-^YcoVlYaa  -YaaBYta,  (5.45) 


p(«no)<l’,  (5.46) 

whkH  yield  tlie  multi  of  |l6]  and  |18]. 

Bemarli  6.2.  Note  that  an  alternative  approach  to  getting 
Caie  2  from  Caie  1  appean  in  [18].  Specifically,  it  waa  ihown  that 
hy  equalising  the  Bj/Hoo  weights  the  coupled  equation  form  of 
Case  1  with  n«  =  n  could  to  transformed  into  the  two  decoupled 
Riecati  equation  form  given  hy  (5.44)  and  (5.45).  However,  this 
approach  does  not  eliminate  the  Hj  aspect  from  the  design. 

Case  3:  Hyland-Berzuteln  Hj/Optlmal  ProjeeUoit 
Theory  [3].In  this  case  we  specialise  the  mnlts  of  Case  1  to  the 
pure  H]  fixed-order  dynamic  compeejation  problem  considered  in 
[3].  Specifically,  by  sufficiently  relaxing  the  Boo  disturbance  atten-  ' 
nation  constraint,  i.e.,  7  -•  oo,  then  (5.16)-  (5.22)  became 
Ac  =  r{A  -  Biq^Pc  -  QaV^^C  +  QcV^^DR^^Pc]G\  (BA1) 
Be  =  Oc  =-Rr^P.G’‘,  (5.48,5.49) 

Q^AQ  +  QA^  +  Vi-  QcV^^Ql  +  (5.50) 

0  =  A^P +PA  +  Ri~  Pjiq'-Pc  +  (5.51) 

0  =  (A  -  ‘P.)4  +  <3(A  -  BPi-^P.)'^ 

+ g.vr^gl  -  rj.g.vi-‘gIrL  (5.52) 

0  =  (A  -  g.V'3-‘C)T>+  p{A  -  g.Va-"C) 

_ + Pls^^r.  (5J53) 

g.=gc^+v„,p.4iTp^'jjT  -■  ■  (5^ 

This  case  corresponds  to  the  resulU  of  [3|  srith  the  added  fea¬ 
tures  of  correlated  plant/measurement  noise  {Vu),  ezoss  weighting 
(Bia),  and  a  direct  transmission  term  (B)  in  the  plant  dynamics. 

Finally,  to  recover  the  standard  LQG  theory  which  involves 
full-order  controllers  set  =  n  so  that  r  =  G  =  p  =  /„  and  rj.  = 
0.  In  this  case  (5.47)-(5.49)  reduce  to  the  standard  LQG  gains  and 
the  last  term  in  (5.50)— (5.51)  is  sero  yielding  the  standard  observer 
and  regulator  Riccati  equations.  Perthermore,  noU  that  (5.53)  and 
(5.54)  are  saprxflaons. 

6.  Kumerleal  Algorithms 

The  malts  of  [l]  and  the  previous  sections  immediately  sug¬ 
gest  that  a  large  class  of  constrained  strueture  control  laws  can  be 
designed  by  numerically  solving  the  optimality  condition  for  ctatic 
output  ferfbaclc.  Considerable  efibrt  has  been  devoted  to  solving 
these  optimality  conditions,  and  a  thorough  survey  can  be  found 
in  [53].  There  eidst,  however,  serious  unresohred  problems  ccacem- 
ing  startup  (i.e.,  the  ability  to  find  an  initial  stabilising  controller), 
convergence,  and  global  optimality  (Le.,  distinguishing  the  global 
minimum  from  local  extremals).  To  this  end,  we  consider  an  al¬ 
ternative  approach  based  upon  homotopy  (Le.,  continuation)  algo¬ 
rithms.  The  theory  and  implementation  of  homotopy  algorithms  is 
well  developed  [54-59].  Becaose  of  the  flexibility  and  global  nature 
of  such  algorithms,  they  appear  to  be  well-f  uited  to  addressing  the 
issues  of  startup,  convergence,  and  global  optimality  for  the  static 
output  feedback  problems.  Results  will  appear  in  [60]. 

7.  Further  Extensions 

1)  decentr^ed  and  hierarchical  feedback  structures  [52]; 

2)  constrained  structure  discrete-time  and  sampled-  data 
control  laws  [61,62]  including  both  single  and  multirate 
architectures; 

3)  structured  real-valued  parameter  uncertainty  [63,66]; 

4)  pole  placement  within  pracribed  regions  [67]; 

5)  nonlinear  dynamic  compensation  via  nonlinear  static  out¬ 
put  feedbag. 

1.  DJ.  BenuUln.  WM.  Hsddtd,  ksd  C.N.  Nett,  'Xtinlcssl  Complsxily 
Control  L&vs  Pvt  It  Problm  Formulatloo  nnd  RoducUoa  to  Static  Out¬ 
put  Foedbook/  Fne.  AGO,  Pituburgh,  PA,  Jum  IftlO. 

3.  W.S.  L«vm«,  TX.  Johnson,  vul  M.  Athwi,  'Optimtl  Limlttd  Stivto 
Vvfftblo  pMdbock  ControUvs  for  Unotr  SyiUmt,*  X4(7,  AC-16. 
7W-TO5, 1971. 

S.  D.C.Gyltad  nod  D.S.  BonuUin,  "rbo  Optimal  ProJoctSon  Equ^tiom  for 
rtXMMnUr  DTnvmc  Compons&Uoo/  JESS  TAO,  AC-39,  1034-1097, 
1984. 

4.  9.  Axiattr,  *Sub-opttnul  Tirso-variab!«  Foodb^  Control  of  Xsbear  By- 
oamfo  Syitomt  with  Random  TopuU,*  UO,  4, 449-466, 1966. 

4.  W.S.  ls4idoo  and  M.  Athani,  *Oa  tha  DaUrminatloa  of  tha  Optimal  Coo- 
slant  Output  Faadback  Cains  for  Uoev  MuUirviaUa  Sratama.”  TSJIS 
TAO,  AC-14,  44-a,  1970. 


6.  A.  Jvnaaon,  *Qp2]t)iilaaifon''ofLinavSyfltaxasotConrtromadCoD6fura- 
licn  •  JJO,  11,  409-431,  1970. 

7.  KXr  Koaut,  *Suboptimal  Control  of  £»Inav''^una-&varian(  Syaie'O*  Sul> 
jaet  Control  Structura  Co9i*r^'nti,*  IEEE  TAO,  A.C-14;  $47-669, 1970. 

8.  C.H.  itnapp  and  S.  Buuthfkur,  *On  Optimal  Output  FaadbacF''  XE£B 

xta,‘AC.r.^  3:«25, 1973.  j, 

9.  H.P.  Horubarsar  and  P.R.  Balanctr*  'Solution  of  tha  Opilmal  Constant 

Output  Faado^  Prob!%cn  by  Cenjucata  GraditMs,*  AC-19, 

434-434.  1974. 

10.  J.  Madanic,  *On  Stabilisation  Optimisation  by  Output  F^rdback,* 
Proc.  TmIM  Atiamwr  Con/.,  412-416.  1976. 

11.  S.  Rarjan  and  D.P.  Loom,  *SynthatIs  oCDacactralisad  Oatput/'Stata  Ra(- 
uiaioft,*  Pfoo.  ACO,  Arlincton,  VA,  743-763, 1063. 

13.  D.3.  Bamatain  and  W.M.  Haddad,  *Roburt  Dacantrallaad  Output  Faad- 

back:  Tha  Static  Controllar  Caaa,*  CDO  1000^1013,  Austin, 

TX,  Dicambar  1966;  SCL,,  13, 1969,  to  app«^*. 

15.  ISL  PaUrs4:., 'DUtutbanca  AttancaUon  axkd  Optimisation:  A  Do- 
•l£n  Method  uaaad  on  tha  Alfabnic  Riecati  Equ^Ion,*  JESS  TAG,  AC- 

33.  437*^429,  1957.  ' 

14.  K.  Zhoti  and  P.F.  KhatfonakAr,  *An  Alfabraie  Riccati  Equation  Ap- 
pcoacli  i&Meo  Optimisation,*  SCL,  11,  64-91, 196^. 

18.  K.  Clerir,  J.C.  Doyle,  *Stata-SpaM  Fonnutaa  foe  All  StabUisInf  Coo- 
trollara  that  Satlcfy  an  H^-Nonn  Bound  and  Ralatlocic  to  Risk  Santittv- 
ity.*  SCL,  11. 167-in,  1966. 

16.  3.C.  Doyla,  K.  Glovar,  PP.  Kharfonakar,  and  BA.  IVa&M,  *3taU*apaca 
Solutions  to  Standard  H'l  and  Hoo  Control  Problains,*  prtprint. 

17.  D  j.N.  limabaar,  EM.  Kasanally,  and  M.G.  Safoc^nr,  *K  Cba;actanaa- 
tion  of  All  Solutions  to  tha  Four  Block  Gaoaral  DistancM  Problam.* 

16.  D.S.  Bamstam  and  W14.  Haddad,  *LQG  Cpot-ol  with  en  Hoo  Parfor* 
manca  Bound:  A  Riccati  Equation  Approach^  IEEE  TAG,  AC-34, 393- 
304, 1969. 

19.  WJ4.  Haddad  and  D4.  Bamatain,  *Compt^a  Solution  to  tba  Hoasiacu- 
Isr  Hi! Ha,  Four  Block  Ptoblan  ■  ACO,  PUUburtb,  ISW. 

20.  B.  FHMisad,  ‘LL-altin,  Formi  of  OptUnum  Slochiutle  TJnw  Revu].- 
ton  ’  Th^uASldS,  S3,  lS4-lf:,  ISTl. 

31.  Y^C.  Ho,  *Liaur  dtocbMtk  Slnfulsr  Coetzol  Pteb^eai.'.''  J.  O/tjn.  n, 
Ani,  9.  34-31, 1ST3. 

33.  M.F.  Hutton,  *Solutioo  of  th.  Sinculsr  Stocfasstlc  Roculstor  Probbm,* 
IhM  ASUS,  65, 414-417. 1673. 

33.  H.G.  K—stsy,  *Min>msl  Oidw  ObMcvm  end  Cwtiin  Sinrdsr  Piobiwn, 
of  OpfimsI  btimstion  ud  Control,*  fSSS  TAO,  AC-19,  374-376, 1974. 

14.  DJ.BdtsadCJI.  JscobMn,5birdu-07«-M(Ceidra'Aei<icu.AcsdeB!c 
Ptcu,  N.W  York,  NY,  1975. 

25.  R.C.  O'MstIqr,  3r.,  end  A.  JwnMon,  ‘Sinpilw  P.ftutbetv»t  ud  Sinfu- 
I»r  Arc.  —  PmS  I,*  ISES  TAO,  AC-10. 316-  -236,  1975. 

26.  R.E.  CMslUy,  Jr.,  sad  A.  JuMSon,  ‘Sinpilsr  Portuibsticn:  sod  Siofu- 
Isr  Arcs  —  Part  n,*  JEEP  TACAC-23. 326- -337, 1977. 

27.  B.A.  Francis  and  K.  Glovtr,  *Boc3d*d  Paakinc  in  th.  Optimal  Unwr 
Rc.ulator  With  Chaap  Control,*  tSKB  TAO,  AC-33, 606-617, 1976. 

28.  B.A.  Francis,  *Tha  Optimal  Unaa^Quadratic  TinM-Invaaant  lUfulator 
with  Cheap  Control,*  IEEE  TAO,  AC-34.  616-631, 1979. 

29.  Dragan  and  A.  Halanay.  'Chaap  Control  and  Sincularly  Poturbad  Ma¬ 
trix  Kiccat!  Oilfrrantial  Equation,*  Hr*.  Hnm.’  JtfaU.  P—c.  rf  AfjA,  26, 
31-40,  1961. 

30.  B.  Has*;  *Tha  Sififular  SUedy  State  Linaar  Ragulator,*  SIAMJ.  CSmCr,, 
30,  347-357,  1963. 

31.  3.  0'R«iny.  *PartIal  Chaap  Control  of  tha  Time-Invariant  tlaculator,* 

UO,  37,  909-937,  1963. 

32.  P.  Sanr.utI,  ‘Dirart  Sinfular  Parturbatioo  Analysis  of  Ilitb-Cain  and 
Cheap  Control  Problem*,*  AjAcmcKct,  19,  41-41,  1963, 

33.  M.L J.  Hautus  and  LM.  Silverman,  'Syetens  Structura  and  Sir.£ular  Con¬ 
trol,*  Un.  Atp  AffL,  SO,  369-403, 1963. 

34.  Y.  Halavi  and  ZJ.  Palmor,  *Extended  Limiting  Fomu  of  Optimum  Ob- 
•ervara  and  I^G  Regulators,*  43,  193-313,  1966. 

35.  D.S.  Berrutein,  "The  Optimal  Projection  Equations  for  Static  and  Dy¬ 
namic  Output  Feedback:  The  Singular  Cal*,*  TAG,  AC-32,  1132- 
1143, 1967. 

36.  Y.  Halevi,  WJ>f.  Ksddsd,  attd  D.S.  Bemstein,  *A  Riccati  Eouation  Ap¬ 
proach  to  the  Singular  LQG  Problem,*  Proc.  ACC,  Pittsburg,  1969. 

37.  A-E.  Bryson  and  D.E.  Jofaanaen,  "Linear  Filtering  tor  Time  Varying  Sya- 
tema  Using  MaasurartMnta  Containing  Colored  Noise,*  lEES  JAO,  AC- 10, 
4-10, 1965. 

36.  3 At. Schumacher,  'ACeometricApproachtotheSingularFilUringProb- 
lenr,*  XEEB  3X0,  AC-30,  773-776, 1965. 

39.  WJd.  Haddad  and  D.S.  Bemateio,  "The  Optimal  Projactlon  Equations 
for  Reduced  Orrler  State  Estimation:  Tlia  Singular  Maaeuismant  Noia* 
Case,*  .(EES  TAO,  AC-52, 1136-1139, 1967. 

40.  Y.  Halevi,  ‘Limiting  Foems  of  Optimal  Obaervart,*  IfO,  47,  309-216, 
1968. 

41.  Y.  Halevi,  "The  Optimal  Raducad  Ordar  Eatimator  for  Systama  with 
Singular  Meaeurem^  Noise,*  IEEE  TAO,  S4, 1969. 

43.  B.  Anderson,  N.  Bose,  and  E.  Jury,  *Output  Feedback  Stabiliaatloa  and 
Ralated  Problema  —  Solution  via  Dacifioo  Mathode,*  JESS  TAO,  AC-X, 
53-66,  1975. 

43.  H.  Kinfiura,  *PoIe  Aaiignmant  by  Gain  Output  Feadback,*  IEEE  3X0, 
AC-M,  509-516, 1975. 

44.  P.N.  Paraskevopouloe,  'General  Solution  to  the  Output  Feedback 
Eigcnvalue-Aseignrtwnt  Problem,*  UC,  27, 109-  -536, 1976. 

4$.  H.  Kimurs,  *A  Further  Result  on  the  Pi^lnn  of  Pole  Aaeignment  by 
Output  Feedback.*  XEES  7X0,  AC-13.  456-463, 1977. 

46.  H.  ICtrrura,  *On  Pols  Aaeigoipint  by  Output  PAdbad,*  UC,  16, 11-33, 

47.  M.  TkroUi,  *On  Output  Feedback  StahUiaatloo  and  Pole  Aaeignment,* 
UO.  31,  399-406, 1960. 

46.  P.T.Ks^amba and R-W. Longman,  *ExactPoleAafIgntaenlUtIngDlraet 
or  Dynamic  Output  Feedback,*  JESS  TAO,  AC-37, 1344-1246, 1911. 

49.  CJ.  Bymaa  and  BJJ.O.  Andtcaon,  *Output  Feedback  and  Ganeric  Sta- 
biliiability,*  51XAf  J.  CoUr.,  11;  361-360,  May  1964. 

50,  M.C.  Smith,  *On  Minimal  Ordar  Stabilisation  of  Singla  Loop  Plante,* 
SCI,  7.  39-40, 1966. 

61.  A.  Unnemann,  *A  Clau  of  Single-Input  Single-Output  Syttems  StabUis- 
abla  by  Reduewl-Otdcr  ContioUen,*  SCL,  11, 37-37, 19M. 

53.  D3.  Bemstain,  "Sequential  Datign  of  Dacentnlised  Dynamic  Compen¬ 

sators  Uting  the  Optimal  Projactioo  Equatiops,*  UO,  46,  1569-1577, 
1967.  *\ 

63,  PJX.MaUIaandH.T.ToIvonen.  *Compulalio.iil  Mathode  for  Paramatric 
LQ  Ptobleme  —  A  Survty,*  FEES  7X0,  AC-33.  e5»-«71, 1987. 

54.  SX.  RIchlar  arid  R.A.  DtCarlo,  'Continuation  Methods:  Theory  and  Ap- 
ph'cations.'ZEEE  TXS,  CAS-SO.  347-553, 1963. 


SS.  P.T.  Kabusba,  It.W.  toocsuaSoi  S.  Jlta-duo,  ‘AHomotopy  Appcoieh.  * 
to  th*  PMdback  SUbiUiaUoa  of  Umv  SjttmoM*  J.  GM.  CMr.  JPymiw 
10, 4»-U},  IMT. 

SC.  L.T.  WatMo,  'AtOORITHM  6»  HOMPACK:  A  SulU  of  CodM  hf 
GlobaUy  Coonrorttot  Homotopgr  A](orithmf  *  ACaf  2>«iul  MM  Sefimtn, 
13.  3S1-310,  IMT. 

37.  L.T.  WolMi^  *aiobill]r  Conrotfoat  Hoiaotopr  Motbodi:  A  Tbtotlil,''  < 
AjrK  MM.  OnfiMt,  to  tppotr.  i 

U.  S.  RidiUr,  *A  Hoiaotopjr  Alforithm  for  Solviax  tbo  Optimal  PnJtcUoa 
EquaUooa  fcr  Ptxad..Oratr  Dynamic  Companaation:  EidaUnca,  Coovar- 
ganca  and  Global  OpUmalily,*  Ana.  AGO,  1137-1131,  Minnaaiwlia,  MN, 
Juna  1»S7. 

S9.  S.  Rlcfatar  and  K.G.  CoUiaa,  Jr.,  *A  Komotopjr  Alcoiithra  for  Raduead* 
Ordar  ControUar  Daalgn  Uamc  toa  Optimal  ProjaeUoa  Eouatiooa,*  JSSS 

cso,  lew. 

.  60.  3.  Rlchtar,  DJ.  Banataia.  E.G,  CoUiaa,  Jr.,  WJhC.  Haddad,  and  CJf. 
Nati,  Tdlidinf'i  Coanplaod^  Control  La*  Syntbaaia,  Part  3:  Kumaneal 
Alforilhma  and  lUiiatnthrt  Exampka,*  in  praparaUoo. 

61.  D.S.  Baanataio,  LJ>.  Davk,  and  D.C.  Hriaod,  *Tba  Optimal  PioJacUon 
Equations  for  Raducad-Ordar,  Disaoto-Tlma  ModaUinc,  EatlmaKon  and 
Contra!,*  ALU  J.  GM.  Omtr.  Din.,  9, 38»-3»S,  1966.  ■ 

63.  DB.  ^aatain.  LJ>.  Daria  and  S.W.  Graalay,  ^ba  Optimal  Prajaction.' 
Squatloos  for  Ecwd-Otdar.  Samplad.Data  Dynamie  C^panaatioai  «itb  , 
Coraputatioa  Dab*,*  XSEE  2X0,  AC-31,  W9-663, 1966. 

63.  WM.  Haddad  aM  DB.  Bamatain,  *Robiiat,  BmhieadAlrdar  Uodaling  • 
via  tha  Optimal  Projaction  Equations  arPb  Patmaaa  Holiot  Bounda,  iEEB  - 
2X0,33,692-491,1966. 

64.  DB.Baciist^  *Rc>Ulat8tabDityaadPacfarBaaoayUPfata(LOtdarDy 
aaaii:  CompaaaaUoD,*  SUMJ,  Aia^37, 399  106, 1969. 

31.  DB.  Bacnat^  and  ^'Jd.  Haddad,  ^tobuat  Stability  and  Parfocmaaea  , 
Tia  Pbtad-Oidar  Dynamic  Cnmpmaarion  with  Onaraiitaad  Coat  Bounds,* 
Jfatk.  OHdr.  3, 1969. 

66.  AJ{.Uadi*ala,WJd. Haddad,  MtdDB.Bacnrtaia,^tabaal  Am  Central 
Dadgn  for  Syitaoa  with  Patamatar  tTocartain'y,*  SOL,  13, 19W. 

67.  WJiLHaddM  and  DB.  Banatain,  *3tatic  Out^t  PasdbM  HagulatioB 
with  Pols  CoocMnts,*  submittad. 


I 


TA3  10:00 


Hj/Hob  Controller  Synthesis:  Illustrative  Numerical  Results  via  Quasi-Newton  Methods 


Dorian  R.  Seinfeld 
Department  of  Mechanical  and 
Aerospace  Engineering 
Florida  Institute  of  Technology 
•  Melbourne,  FL  32901 


Waasim  M.  Haddad‘  Dennis  S.  Bernstein* 

Department  of  Mechanical  and  Harris  Corporation 

Aerospace  Engineering  .Government  Aerospace  Systems 
Florida  Institute  of  Technology  Division,  MS  22/4847 
Melbourne,  FL  32901  Melbourne,  FL  32902 


Carl  N.  Nett* 
Department  of  Aerospace 
Engineering 

Georgia  Institute  of  Technology 
Atlanta,  GA  30332 


Abstract 

A  qsui-Kewtoa  wuch  KehaklBe  is  applied  to  the  Szcd-stracturc  B]/H„ 
cosirol  probicBi  lalrodcced  ia  (1,21.  This  qaass-Ksvtoa  tcchauiae  a  based  apoa 
ihe  3FGS  variable  melric  altoiithm  developed  ia  [3]  for  aaeoaslraiaed  soa^- 
car  oplimiiatioB.  A  barrier  modiScatioa  is  osed  to  e^orcs  elosed-iMp  stability, 
vhile  a  daaete  bomotopy  is  ssed  to  eaforcs  aa  ILa  eoastraiat.  Kcrnerkal  re- 
islts  for  three  difereat  illastrathre  problelss  art  prsseaud. 

1,  Introduction 

la  a  recent  paper  ll|  it  vas  shown  that  a  targe  class  of  Exed-sttaetare 
control  taws  eaa  be  recast  as  static  oatpat  fecdbaclt  controllers  for  a  saitably 
ESodiSed  plant.  Accordingly,  a  general  theory  was  constmeted  in  (2)  for  static 
ootpat  feedback  control  design.  The  resalu  of  (2)  couidcr  the  nsaal  H,  perfor- 
sssce  nteware  and  also  aa  sL,  criterion  to  permit  sifflaltaaeoas  consideration 
of  both  Hj  and  H«,  design  aspects.  This  formnUtson  thas  permiu  the  treat¬ 
ment  of  loop  shaping  tad  anatmetared  anccrtaialy  as  well  as  nominal  ncs 
speciheatioas.  In  this  paper  we  present  a  anmerkal  method  for  solving  the 
s^tems  of  coapled  Riccui  e<iaatioBs  that  emaaau  from  Ihe  theory  developed 
in  (1,2|.  Resalu  are  presented  for  three  benehmsrk  problems. 

1.  Numerical  Procedum 

The  namerkal  procedure  atHises  software  developed  ia  (3]  for  nneonstr wed 
nonlinear  optimisuion  based  on  Ihe  BFCS  variable  metric  algorithm  combined 
wish  a  standard  LQG  software  package.  The  coatroUtr  synthesis  algorithm  eti- 
lises  the  3rGS  <iaui-Ncwtoa  technique  {4-41  minimise  the  coat  as  a  fanction 
of  the  controller  gains.  A  namber  of  modilcations  to  the  code  have  been  im- 
plemeaud  to  address  the  controller  synthesis  problem  developed  m  12|.  Specif¬ 
ically,  a  barrier  moiRScalioa  is  osed  to  enforce  stabilily,  while  a  discreU  homo- 
topy  proeednre  is  ased  to  enforce  the  3«.  constraint,  'ne  atarting  point  for  the 
algorithm  it  asnsHy  chosen  to  be  aa  LQG  controller  which  it  then  cranafermed 
into  the  desired  redaced'^rder/decentralised/H«,.conatraiaed  solatioa. 

As  shosrn  in  (2|,  the  cost  faactional  depends  on  both  the  slate  covatMce 
and  its  daal  which  are  solutions  of  a  modified  Riccsti  eqaation  and  a  modified 
Lyapunov  conation.  These  coupled  equations  arc  solved  nsing  standard  LQG 
software,  as  well  as  a  Newton-Raphsoa  method  [7|  developed  for  soKing  the  B«. 
Riccaii  equation  thu  enforces  the  Ho.  norm  eoastraiat.  The  BFGS  algorithm  is 
iaUgrated  srith  the  LQG  software  to  provide  updated  galas  at  each  computation 
tup  (ue  Figure  I). 

3.  Deriga  Examples 

The  bt  example  itaaHjoptimal  deceatralised  control  problem  involvug 
a  pair  of  simply  tapported  Ealcr-Bemoulli  Sexibic  beams  iaurconnecied  by  a 
spring  [g|.  rVh  beam  has  one  rate  sensor  and  one  force  actuator.  The  Sth- 
order  iaterconneeced  model  iacludct  two  vibration  modes  ia  each  beam.  This 
problem  was  addressed  in  (8|  and  solved  via  homotopie  continuation  methods 
ia  [9].  As  ia  [8,9],  wc  obtain  two  deuairaliscd  4lh  order  eompentaurs;  one  for 
each  beam.  The  final  Hi  cost  is  11.9450  rcficclisg  a  slight  improvement  over 
the  resalts  of  [8,9|.  This  retail  was  obtained  ly  optimising  both  compensators 
limnliaaeoasly  in  a  tingle  iteration  loop  initialised  with  LQG  gains.  Ia  contrast, 
the  method  of  [8,9|  reqaires  a  sequential  design  of  each  tabconlroUer. 

The  second  design  example  is  adopud  from  |10|  and  involves  foar  coapled 
rotatbg  ditlu  with  noncolocattd  sensors  and  actaalotn.  The  plant  it  of  eighth 
order  and  has  two  ncntrally  stable  poles  and  three  right  half  plane  scros.  The 
problem  data  are  given  in  {10|.  A  series  of  mixed-norm  Hi/H..  results  was 
obtained  for  both  fall-  and  rMaced-ordcr  controllers  as  well  as  pare  Hi  reduced- 
order  results.  The  mixed-norm  fall^rder  problem  ms  solved  via  homotopie 
contbantioa  methods  in  (10)  for  a  act  3.,  performance  improvement  of  8.7  dB 
over  the  bitial  LQG  controller.  For  ihb  example,  ws  were  able  to  oblab  aa 
Ho.  disterbtace  attesnatbn  construat  of  0.29  correspondbg  to  u  actual  H,. 
performance  of  0.28.  This  corresponds  to  an  H,.  performance  uaprcvemcat 
of  134  dB  over  the  LQG  controller  (see  Fi^c  2),  or  5.1  dB  over  the  fall- 
order  result  obtabed  b  (lOj.  We  also  oblamcd  rranced-erder  compensators 
for  the  mixed-norm  problem  for  the  above  example.  For  an  Hm  disturbance 
atteanatba  constrabt  of  .44  we  obtained  an  actual  H..  performance  of  .42 
with  a  2ad-ordcr  compensator  (see  Figure  2].  Controller  characteristics  for  the 
redneed-order  mixed-norm  problem  are  p^en  b  Table  1  for  several  vslaes  of 
dittarbance  altenaation  constrabt  7. 

For  the  same  example,  wt  alto  considered  redcced-oidcr  Hj  designs  as  b 
[ill  ’rhieh  compares  the  Optimal  projectioa  methodology  to  five  other  methods 
to  oblab  stable  rcdaced-order  designs  for  varybg  valaes  of  Ihe  disimbancs 
noise  btensity  {3.  Usbg  stable  bitial  designs  we  obtabed  stable  designs  for 
all  of  the  cases  Masidered  b  [tl|.  Table  2  shows  the  resalts  for  the  second  and 
foarth<rder  controller  design  along  with  them  eoircspondbg  Ks  costs. 

The  final  example  considered  b  a  model  of  a  GB  TTOO  turboshaft  en- 
gbe  coapled  to  a  hclicopur  rotor  sysum  |1^.  Thu  problem  addresses  the 
malti-bpat  mnItMalpat  (MIMO)  dynamb  coordbatbn  of  both  faci  and  en- 
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gbe  compressor  geometry  b  both  aa  optimal  Hj  and  H..  sense.  For  this 
escsmple  ere  addressed  the  mbed  sensitivity/complementary  sensittvity  mins- 
misation  problem  for  the  95%  Sg  MIMO  data  presented  b  [12j.  This  data 
represents  the  simultanccas  control  of  power  tarbbe  speed  (b  RPM)  and 
bter-tarbbe  gas  temperature  (b  deg.  R)  for  a  Ibeaeised  model  operatbg 
at  a  95%  power  level  (%  N,).  As  reported  b  |12|,  Ihe  design  specification  on 
Ihe  loop  gab  transfer  functions  requires  a  crossover  frrqaeacy  no  greater  than 
10  rad/sec  with  a  low  frequency  performance  barrier  of  20  dB  at  frequencies 
at  or  below  1  rad/sec.  b  order  to  meet  the  design  reqairemenU  we  solved  the 
mixed  perfocmaacs/robnstness  problem  of  the  form  (sec  [13|  for  farther  dctnilt] 

T{G,K)  «  juqrj  weights  (see  Figure  3)  Wi  w  »ifu,  Wj  “  wjfj, 

where  >»i{s)  «  (a*  +  4s  +  0X01)/(s*  +  0.65),  i»j(s)  (60s  +  500}/(s  500). 
Usbg  these  weightbg  fanctbns  on  the  sensitivity  transfer  funetbn  matrb  8 
and  complemenlary-iensitivity  transfer  function  matrb  T  oar  design  satisfied 
the  performance  objectives  as  illnstrated  b  ^gnres  4, 5  and  6. 
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Abstract 

It  is  well  known  that  Goh’s  transformation  can  be  used  to  transform  the  singular  linear- 
quadratic  regulator  problem  into  a  nonsingular  problem.  The  solution  to  this  transformed  problem 
is  then  given  by  a  variant  of  the  standard  Riccati  equation,  called  here  the  Goh-Riccati  equation. 
The  goal  of  this  paper  is  to  study  the  role  of  the  Goh-Riccati  equation  in  solving  the  singular 
linear-quadratic  regulator  problem.  We  approach  this  problem  from  several  distinct  points  of  view. 
These  include  perturbation  methods  and  generalized  Legendre-Clebsch  conditions,  as  well  as  fixed- 
structure  optimization. 
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1.  Introduction 


Singular  optimal  control  problems  have  been  intensely  studied  fo.  almost  three  decades  now. 
Since  the  original  analysis  of  Lawden’s  spiral  [1-3],  there  heis  been  significant  interest  in  searching 
for  necessary  and  sufficient  conditions  that  establish  the  status  of  singular  trajectories.  References 
[1-83]  are  representative  of  research  in  this  area,  although  this  bibliography  is  far  from  exhaustive. 
The  present  paper  is  concerned  with  one  particular,  but  fundamental,  singular  optimal  control 
problem,  namely,  the  time-invariant,  infinite-horizon,  singular  linear-quadratic  regulator  problem 
without  control  constraints.  This  problem  can  be  simply  stated  as  follows. 

Singular  Linear-Quadratic  Regulator  Problem.  Given  the  linear  system 


X  =  Ax  +  Bu,  a;(0)  =  ioj 


find  a  control  u(>)  that  minimizes 


J(u(*),a:o)=  [ 

Jo 


x'^Rx  dt. 


(1.1) 


(1.2) 


In  general,  solutions  to  this  problem  involve  both  impulsive  controls  and  smooth  feedback 
controls.  For  reasons  discussed  below,  this  paper  is  solely  concerned  with  the  latter. 

There  are  both  mathematical  and  engineering  reasons  for  considering  singuleir  problems.  Math¬ 
ematically,  attempts  to  solve  singular  problems  have  contributed  to  the  development  of  a  wide  range 
of  solution  techniques  of  intrinsic  value.  These  include  transformation  methods,  perturbation  tech¬ 
niques,  higher-order  optimality  theory,  and  geometric  methods. 

From  an  engineering  point  of  view,  singular  problems  serve  as  idealized  approximations  to 
cheap  control  problems  in  which  control  effort  is  not  treated  as  a  limiting  factor  in  feedback  design. 
Solutions  to  such  problems  assist  the  control  designer  in  assessing  tradeoffs  between  available  con¬ 
trol  effort  and  achievable  system  performance.  For  example,  as  shown  in  [35,36],  the  presence  of 
right  half  plane  plant  zeros  limits  achievable  performance  in  spite  of  unbounded  controller  effort. 
Analogous  remarks  apply  to  the  dual  problem  of  noiseless  sensors. 

The  pur,  ose  of  this  paper  is  to  study  feedbcick  control  for  the  Singular  Linear-Quadratic  Reg¬ 
ulator  Problem  by  means  of  several  quite  differenct  techniques,  but  with  a  unified  focus.  That 
focus  is  the  Goh-Riccati  equation,  a  variant  of  the  standard  Riccati  equation  which  follows  from 
applying  Gch’s  transformation  [18,19]  to  the  singular  problem  to  obtain  a  nonsingular  problem.  In 
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the  present  paper  we  derive  the  Goh-Riccati  equation  by  means  of  four  distinct  methods,  namely, 
Goh’s  transformation,  perturbation  methods,  generalized  Legendre-Clebsch  conditions,  and  fixed- 
structure  optimization. 

The  first  derivation  of  the  Goh-Riccati  equation  given  in  this  paper  is  via  Goh’s  transformation. 

Details  of  the  transformation  can  be  found  in  [44],  pp.  81-85,  while  the  Goh-Riccati  differential 
« 

equation  appears  as  equation  (4.5.27)  of  [44].  Generalizations  of  Goh’s  transformation  were  devel¬ 
oped  in  [67]  to  obtaiin  higher  order  extensions  of  the  algebraic  Goh-Riccati  equation.  As  pointed 
out  in  [67],  Goh’s  transformation  was  lediscovered  in  [31]. 

The  second  derivation  of  the  Goh-Riccati  equation  is  by  means  of  a  perturbation  technique. 
For  the  algebraic  equation  C2ise  this  approach  was  first  ceirried  out  in  [30].  This  technique  was 
subsequently  generalized  in  [74]  to  obtain  higher  order  extensions  of  the  Goh-Riccati  equation. 
Neither  paper  [30,  74],  however,  recognize  connections  with  Goh’s  transformation. 

The  third  derivation  of  the  Goh-Riccati  equation  given  herein  is  by  means  of  higher  order 
optimality  conditions.  The  study  of  singular  control  problems  by  means  of  higher  order  optimal¬ 
ity  conditions  has  been  quite  extensive.  Generalized  Legendre-Clebsch  conditions  were  developed 
in  [12,21]  and  numerous  other  references.  To  our  knowledge,  however,  connections  between  the 
generalized  Legendre-Clebsch  conditions  and  the  Goh-Riccati  equation  have  not  been  established. 
In  the  present  paper  we  close  this  gap  by  deriving  the  Goh-Riccati  equation  be  means  of  the 
Legendre-Clebsch  conditions. 

The  fourth  approach  to  deriving  the  Goh-Riccati  equation  considered  in  this  paper  is  by  means 
of  fixed-structure  optimization.  By  fixed-structure  optimization  we  are  referring  to  the  method  in 
which  the  feedback  controller  structure  is  fixed  prior  to  the  optimization  [84-86].  The  controller 
parameters,  such  as  feedback  gains,  are  then  determined  by  the  optimization  procedure.  There  are 
two  principal  reasons  for  applying  fixed-structure  optimization  to  the  Singular  Linear-Quadratic 
Regulator  Problem.  Firstly,  the  fixed-structure  approach  allows  us  to  focus  directly  on  control 
signals  of  a  specific  class  such  as  feedback  controls.  In  a  cheap  control  problem,  feedback  controls, 
as  distinct  from  impulsive  controls,  are  necessarily  smooth  and  finite,  and  thus  can  be  viewed  as 
the  singular  portion  of  the  optimal  control.  And  secondly,  the  fixed-structure  approach  allows 
control  designers  to  enforce  control-structure  constraints  such  as  controller  order,  decentralization, 
etc.  [85,86]. 
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Recently,  the  fixed  structure  approach  has  been  applied  to  control  problems  with  singular 
control  weighting  and  singular  measurement  noise  [75,76,83].  These  papers,  however,  did  not 
establish  connections  with  the  Goh-Riccati  equation.  Thus  our  goal  in  the  present  paper  is  to 
derive  the  Goh-Riccati  equation  by  means  cf  the  fixed-structure  approach.  Ultimately,  we  intend 
to  merge  the  Goh-Riccati  equation  with  the  results  of  [75,76,83]  as  well  as  [84-86]  to  obtain  a 
general  theory  of  fixed-structure  control  for  both  singular  and  nonsingular  problems. 

The  plan  of  the  paper  is  as  follows.  In  Section  2  we  present  a  self-contained  derivation  of 
the  nonsinguleir  linear-quadratic  regulator  problem  under  weak  assumptions.  The  fixed  structure 
approach  is  used  in  this  section  to  illustrate  the  technique  that  will  subsequently  be  applied  to 
the  singular  problem  in  Section  6.  Goh’s  transformation  is  utilized  in  Section  3  to  transform  the 
singular  problem  into  a  nonsingular  problem.  The  results  of  Section  2  are  then  applied  to  the 
transformed  problem  to  obtain  the  Goh-Riccati  equation.  In  Section  4  the  singular  problem  is 
perturbed  to  obtain  a  nonsingular  approximate  problem.  By  assuming  an  asymptotic  expansion 
for  the  solution  to  the  standard  Riccati  equation,  the  Goh-Riccati  equation  is  shown  to  characterize 
the  zeroth-order  term  in  the  expansion.  The  generalized  Legendre-Clebsch  conditions  are  applied 
to  the  singular  problem  in  Section  5.  By  introducing  a  transformation  involving  the  solution  to  the 
Hamiltonian  system,  we  obtedn  the  Goh-Riccati  equation.  Finally,  in  Section  6  we  return  to  the 
fixed-structure  approach  which  is  now  applied  to  the  singular  problem.  By  introducing  a  series  of 
transformations,  we  arrive  at  the  Goh-Riccati  equation. 

2.  The  Nonsingular  Linear-Quadratic  Regulator  Problem  via  Fixed-Structure 

Optimization 

To  begin,  we  study  the  nonsingul2ir  linear-quadratic  regulator  problem  using  fixed-structure 
techniques.  Besides  establishing  notation,  assumptions,  eind  techniques  that  will  be  used  in  later 
sections,  we  shall  focus  on  details  that  are  not  normally  addressed  in  standard  treatments  of  this 
problem. 

Linear- Quadratic  Regulator  Problem.  Given  the  linear  system 

i  =  Ax  +  Bu,  x(0)  =  xo,  (2.1) 

with  feedback  control  law 

u  =  Kx,  (2.2) 
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determine  K  e  that  minimizes 


rOO 

J{K,xo)=  /  [c’^i2ix+ 2x’^i?i2U+ u’^i22«]  dt. 

Jo 


(2.3) 


Several  comments  are  in  order.  First,  in  (2.1)  we  mean  x  =  x{t)  €  IR”  and  u  =  u{t)  €  IR*”, 

t  >  0,  with  given  initial  condition  a:(0)  =  xq.  We  assume  throughout  the  paper  that  m  <  n. 

Furthermore,  A  €  IR”^”,  B  €  Ri  =  €  IR"^”  (superscript  “T”  denotes  transpose), 

Ri2  e  and  i?2  €  The  matrix  R^  =  S  €  ir(«+”‘)x(«+»^)  is  assumed 

[Xll2  -^2 

to  be  nonnegative  definite,  and  R^  is  zissumed  to  be  positive  definite.  Hence  Ri  and  R[  =  Ri  - 
both  nonnegative  definite.  Note  that  the  admissible  controls  (2.2)  are  constrained 
a  priori  to  be  of  the  form  of  full-state  feedback. 

For  arbitrary  K  €  IR”^^",  the  closed-loop  system  (2.1),  (2.2)  has  the  form 


X  =  Ax,  x(0)  =  a:o> 


(2.4) 


where  A  =  A  +  BK,  while  the  cost  (2.3)  is  given  by 


where 


Since  R  = 


lT 


R. 


J(K,xo}=  f  x^Rx  di,  (2.5) 

Jo 


R=Ri  +  RuK  +  K'^Rii  +  K'^RiK, 


,  where  I  or  I„  denotes  the  n  X  n  identity  matrix,  it  follows  that  R  is 


K\  “[if] 

nonnegative  definite.  Hence  for  arbitrary  K  €  IR’”^”,  0  <  J{K,xq)  <  oo.  Since  the  closed-loop 
system  (2.4)  has  the  solution 

x{i)  =  e^*Xo,  t>0,  (2.6) 


the  cost  (2.5)  becomes 


J{K,xo)  =  [  XQe^'^^Re^^'xo  dt. 
Jo 


(2.7) 


Remark  2.1.  A  more  general  formulation  of  the  regulator  problem  is  obtained  by  averaging  or 
summing  J{K,xq)  over  values  of  lo  [84].  It  can  be  seen  that  this  leads  to  (2.8)  with  xqXq  replaced 
by  an  n  X  n  nonnegative-definite  matrix  V.  If  V  has  rank  1,  then  the  original  problem  is  recovered. 
Allowing  the  rank  of  V  to  be  greater  than  1  provides  a  more  general  problem  formulation  that 
captures  the  possibility  that  xa, belongs  to  a  given  subspace. 
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The  expression  (2.7)  for  the  cost  suggests  the  importance  of  the  nonnegative-definite  matrix 


/ 


(2.8) 

Jo 

when  this  integral  exists,  that  is,  is  finite.  If  (2.8)  exists,  then  (2.7)  can  be  written  as 

J{K,xo)  =  XqPxq.  (2.9) 

Of  course,  J{K,xq)  may  be  finite  even  if  (2.8)  does  not  exist.  It  is  well  known  that  P  given  by 
(2.8)  is  intimately  related  to  the  Lyapunov  equation 

Q  =  A^Pd-PA  +  R.  (2.10) 

The  following  result  characterizes  the  class  of  nonnegative-definite  solutions  to  (2.10). 

Lemxaa  2;1.  Let  K  €  IR*”^”.  Then  the  following  statements  are  equivalent: 

t)  P  given  by  (2.8)  exists. 

it)  There  exists  a  nonnegative-definite  solution  to  (2.10). 

tit)  The  observable  subspace  of  (R,  A)  is  contained  in  the  asymptotically  stable  subspace  of  A. 

In  this  case  the  following  properties  are  satisfied: 
iv)  P  given  by  (2.8)  satisfies  (2.10). 

* 

to  (2.10)  such  that 

(2.11) 

m)  Every  nonnegative-definite  solution  to  (2.10)  is  of  the  form  P  -b  Pq,  where  P  is  given  by  (2.8) 
and  Po  is  am  arbitrary  nonnegative-definite  matrix  satisfying 

0  =  A^Po  +  PoA.  (2.12) 


v)  P  given  by  (2.8)  is  the  only  nonnegative-definite  solution 


rank  P  —  rank 


R 

RA 


\RA^ 


-1 


vit)  If  Po  is  a  nonnegative-definite  solution  to  (2.12),  then  rank  Po  =  +  27,  where  0  <  ^  <  &, 

0  <  7  <  f ,  £  is  the  number  of  Jordan  blocks  of  A  associated  with  the  eigenvalue  zero,  and  q  is 
the  number  of  Jordan  blocks  of  A  associated  with  nonzero  eigenvalues  having  zero  real  part. 
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viiz)  P  given  by  (2.8)  is  the  only  nonnegative-definite  solution  to  (2.10)  if  and  only  if  every  eigenvalue 
of  A  has  nonzero  real  part. 

ix)  A  is  asymptotically  stable  if  and  only  if  (.R,A)  is  detectable. 

x)  P  given  by  (2.8)  is  positive  definite  if  and  only  if  {R,  A)  is  observable. 

Proof.  The  result  follows  from  Theorems  3.1b,  3.2,  4.'lb,  and  4.2b  of  [88].  □ 

The  previous  result  focused  on  the  class  of  nonnegative-definite  solutions  to  (2.10).  In  general, 
however,  there  may  exist  indefinite  or  nonsymmetric  solutions.  Such  solutions  are  ruled  out  in  the 
case  A  is  asymptotically  stable.  The  following  result  is  well  known. 

Lemma  2.2.  Let  K  €  and  suppose  A  is  asymptotically  stable.  Then  P  given  by  (2^9) 

exists  and  is  the  only  solution  of  (2.10).  Furthermore,  (2.11)  holds. 

Pemark  2.2.  Lemma  2.1  shows  that  if  P  given  by  (2.8)  exists,  then  P  is  the  minimal 
nonnegative-definite  solution  to  (2.10).  Furthermore,  v)  implies  that  P  gr  en  by  (2.8)  is  the  unique 
minimal-rank  nonnegative-definite  solution  to  (2.10)  in  the  sense  that  a!!  other  solutions  P  +  Pq, 
where  Po  is  nonzero,  nonnegative  definite,  and  satisfies  (2.10),  must  hav.i  rank  greater  than  the 
rank  of  P. 

Now  define  a  Lagrangian 

£(K,  P)  =  Aotr  PV  +  tr  Q[A'^P  +  PA  +  R], 


where  Aq  >  0  and  Q  €  are  Lagrange  multipliers.  Since  the  constraint  equation  (2.10)  is 

symmetric,  we  require  Q  to  also  be  symmetric.  Then,  viewing  P  as  a  free  variable,  we  compute 


—  —  {B'^P+  Ri2  +  RzK)Q, 

(2.13) 

dC 

=  AQ  -f-  +  XqxqXq  . 

,{2.14) 

Setting  =0  and  =0  yields 

(2.15) 

0  =  AQ  -h  QA^  -f-  AoaJos-’o  • 

(2.16) 

Next  using  (2.15)  sfceindard  results  imply  that  K  is  given  by 

K  =  -R2^(b'^p + p?2)gg+  -1-  M{I.  -  Qg+), 

(2.17) 
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where  (3+  is  the  generalized  inverse  of  Q  and  M  €  is  arbitrary.  Conversely,  for  all  M  E 

each  matrix  K  given  by  (2.17)  satisfies  (2.15).  Nota  that  equation  (2.16)  for  Q  is  dual  to 
(2.11)  so  that  Lemma  2.1  applies  with  obvious  modifications. 

Although  the  gain  K  given  by  (2.17)  is  not  unique  (since  A‘  ■’rbitrary),  we  can  show  that 
this  nonuniqueness  in  irrelevant  to  the  optimization  problem’.  L':.  i.  .  -*Js  we  first  present  a  result 
that  characterizes  the  class  of  reachable  states.  Let  “JS”  di.-  ran  v- 

Lemma  2.3.  Let  K  €  xq  €  IR”^.  and  ti  >  0.  Then 

0<i<ti}c  je((a:o  Axo-**A”-^iol)  =  ^(r  ds).  (2.18) 

Jo 

If,  in  addition,  *  ds  is  finite,  then 

c’^^xqXq  ^  ds)  =  Jl{[  e^^xoXQe^’^*  ds).  (2-19) 

Jo  Jo 

Proof.  The  inclusion  in  (2.18)  follows  from  the  Cayley-Hamilton  theorem,  while  the  equcility 
b  (2.18)  is  given  by  Theorem  3,  p.  79,  of  (87).  Finally,  (2.19)  is  easily  shown.  □ 

Next  we  show  that  the  cost  J{Ky  xo)  is  independent  of  the  choice  of  M  in  (2.17).  To  do  this  first 
note  that  although  Q  satisfying  (2.16)  is  symmetI^.,  it  does  not  necessarily  follow  that  (2.16)  has  a 
nonnegative-definite  solution.  Hence  we  nov/  make  the  assumption  that  the  controllable  subspace 
of  (A,  xo)  is  contained  in  the  asymptotically  stable  subspace  of  A.  Then  by  the  dual  of  Lemma  2.1 
it  follows  that  Q  given  by 

Q  =  [  e'^^xoXg  dt  (2.20) 

Jo 

exists  and  satisfies 

0  =  AQ  +  QA^-{-xox'S  (2.21) 

that  is,  (2.16)  with  Aq  =  1. 

Next,  it  follows  from  Lemma  2.3  that  the  solution  x(t)  of  the  closed-loop  system  (2.6)  lies  in 
the  subspace  R{Q).  However,  if  x  €  Jl{Q)  then  x  =  Qz  for  some  z  €  IR”  so  that  (2.17)  implies 

Kx  =  -R2^{B'^P  +  RJ^)QQ^Qz  +  M{I  -  QQ+)Qz 
=  -R2^{B'^P  +  RJ^)Qz 
=  -i?2-i(B'rp-f-<^)x. 
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Hence  the  control  u(t)  =  Kx{t)  is  independent  of  the  choice  of  M.  Setting  for  convenience 


M  =  -B2^{B’^P  +  RJ2)  (2.22) 

yields 

K  (2.23) 

Note  that  the  gain  (2.23)  agrees  with  (2.17)  in  the  case  that  Q  is  positive  definite.  Hence  the 
expression  (2.23)  is  maximal  in  the  sense  that  it  characterizes  optimal  values  of  K  regardless  of  Q. 

Finally,  substituting  (2.‘i3)  into  (2.10)  yields  the  i.randcird  Riccati  equation 

0  =  A^P  +  PA+Ri-  Pj Ri^Pa,  (2.2i) 

where  Pa  =  B'^P  +  Pj'j.  Equation  (2.24)  can  also  be  written  as 

0  =  A'^P  +  PA'  +  R'l  -  PBRi^B'^P,  (2.25) 


where 

A' =  A-  BR2^R'^2>  Ri  =  Ri-  RnRz^Ru  • 

As  noted  previously,  PJ  is  nonnegative  definite.  If  (A,  B'  'i  stabilizable  (so  that  (A',  B)  is  also  stabi- 
lizable),  it  follows  from  [88]  that  (2.25)  has  a  maximal  no..negative-definite  solution  P.  Furthermor.', 
if  K  is  given  by  (2.23)  with  P  the  maximal  soltuion  of  (2.25),  then  every  eigenvalue  of  A  =  A-VBK 
lies  in  the  closed  left  half  plane.  To  illustrate^this  fact,  let  A  =  0,  B  =  1,  Pi  =  0,  RiZi  =  0,  and 
Ps  =  i.  Then  P  =  0  is  the  only  solution  and  hence  the  maximal  solution  to  (2.25).  Since  K  =  0, 
A  =  A  =  0.  If,  however,  'Pi,A')  is  detectable,  then  (2.25)  has  exactly  one  nonnegative-definite 
solution  P,  and  the  corre. ,)onding  closed-loop  system  is  asymptotically  stable  [89].  If  (Pi,A')  is 
not  detectable,  then  (2.25)  may  have  more  than  one  nonnegative-definite  solution.  It  then  follows 
from  the  form  of  the  cost  (2.9)  that  J{K,xq)  is  minimized  by  choosing  the  minimal  solution  of 
(2.25).  For  related  details  see  [91,92].^ 

^  The  key  results  in  [91,92]  can  be  summarized  as  follows:  Assuming  (A,  P)  stabilizable  (so 
that  (A',P)  is  also  stabilizable),  the  RLcati  equation  (2.25)  will  have  multiple  nonnegative-definite 
solutions  to  the  extent  that  (A',  P()  is  undetectable.  Detectable  eigenvalues  are  stabilized  by  each 
such  solution,  while  undetectable  eigenv2dues  either  remain  invariant  or  are  refiected  into  the  left 
half  plane  by  the  v  vtious  solutions.  Moreover,  every  undetectable  eigenvalue  is  reflected  into  the  left 
hali  pia,.<,  t.  the  maximal  solution.  However,  reflection  does  not  affect  undetectable  eigenvalues 
lying  on  the  imaginary  axis  wjiich  thus  are  not  stabilized.  If  (A,  5)  is  not  stabilizabje,  then  available 
results  are  less  complete  [93-96]. 
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3.  Goh’s  Transformation 

In  this  section  we  review  Goh’s  transformation  [17,18,43]  which  transformd  the  Singular  Linear- 
Quadratic  Regulator  Problem  into  a  nonsingular  problem.  By  applying  the  standard  theory  to  the 
trcinsformed  problem  we  obtain  the  Goh-Riccati  equation,  a  singular  variant  of  the  standard  Riccati 
equation. 

As  in  Section  2  we  consider  the  linear  equation 

X  =  Ax  +  Bu,  2(0)  =  lo,  (3.1) 

with  singular  cost  functional 

•^s  («(•).  a:o)=  Hx'^Rxdt,  (3.2) 

Jo 

which  is  the  same  as  (2.3)  with  Ri  =  R,  R^  =  0,  and  i?2  =  0-  For  Goh’s  transformation  define 

z{t)  =  x(t)  —  Bv(t)f  v{t)  =  f  u{s)  ds  +  Vo,  (3.3) 

Jo 

so  that 

z{t)  =  Ax{t),  v{t)  =  u(t),  (3.4) 

and 

z(0)  =  xo  -  Bvq,  t;(0)  ==  Vo.-  (3.5) 

Hence  it  follows  that  z{t)  satisfies 

i(t)  =  Az{t)  +  ABv{t),  z{0)  =  xq  —  Bvq.  (3.6) 

If  closed-loop  stability  is  desired,  then  it  is  necessary  to  determine  whether  (A,  AB)  is  stabilizable. 
Lemma  3.1.  The-following  two  statements  are  equivalent: 
t)  (A,  J5)  is  stabilizable  and  A  is  nonsingular, 
it)  (A,  AB)  is  stabilizable. 

Proof.  If  (A,B)  is  stabilizable  then  so  is  (SA5~^,SB)  for  all  nonsingulcir  S  e  IR”^”.  Choos¬ 
ing  5  =  A,  it  follows  that  (AAA~^,  AB)  =  (A,AB)  is  stabilizable.  Conversely,  suppose  (A,AB)  is 
stabilizable.  Then  by  the  PBH  test  it  follows  that 

rank(jj[A/  -  A  AB]  =  n,  A  6  C,  Re  A  >  0.  (3.7) 
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Setting  A  =  0  this  implies  rank[-A  AB\  =  n,  which  in  turn  implies,  since  [-A  AB]  =  A[~I  B], 
that  A  is  nonsingular.  Now,  since  A  is  nonsingular,  if  (A,  AB)  is  stabilizable,  then  so  is  (A  AA, 
A-^AB)  =  {A,B).  □ 

For  the  transformed  system  (3.6)  the  cost  (3.2)  becomes 
Js{v{‘)yz(P))  =Jsiu{‘),xo) 

=  Js(i;(*),^^(0)  +  Bvq) 

=  n(z  +  BvfR{z  +  Bv)dt 
Jo 

=  r  [z’^Rz  +  2z'^RBv  +  v'^B'^RBv]  dt. 

Jo 

Note  that  (3.8)  has  the  form  of  the  cost  function  (2.2)  v/ith  R12  =  RB  and  R2  =  B'^RB.  Note 
that  in  this  case  Ra  becomes 

_  R\  Ri2  R  RB  _  In  p 

R2\~[b'^R  B^iJB J  “  L^’^J  ’ 

which  is  nonnegative  definite. 

Now  we  assume  that  B'^RB  is  positive  definite  so  that  is(v(‘)>^(0))  ^  nonsin¬ 

gular  cost  functional.  Note  that  it  follows  from  this  assumption  that  rank  B  =  m  and  rank  R>m. 
Assuming  now  a  feedback  solution  of  the  form 


vit)=K'z{t), 


it  follows  from  (2.23)  that 


K'  =  -{B'^RB)-%AB)'^P  +  {RBf] 


K'  =  -(B'^BB)-^B’^(A'^B  +  R), 


(3.10) 


where  P  satisfies 


0  =  A'^P  +  PA  +  B  -  [{ABfP  +  (BB)’^]'^(B'^PB)-M(AB)^P  +  (PB)^) 


0  =  A'^P  +  PA+Rr  +  B)'^B(B'^BB)-^B'^(ATP+  B). 


(3.11) 
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(3.12) 


We  call  (3.11)  the  Goh-Riccati  equation.  An  equivalent  form  of  (3.11)  is 

0  =  [7„  -  +  PA[7„  -  B{B’^ RB)-^ B'^ R] 

+  R-  RB{B'^RB)-^B^R  -  PAS(S'^PB)-^S'^A'^P. 


There  are  several  consequences  of  the  above  relations  that  should  be  noted.  First,  it  follows 
from  z{0)  =  xo  —  Bvq  and  vq  =  v(0)  =  K'x(0)  that 


{In  +  BK')z{0)  =  xo 

(3.13) 

and 

iIrr.  +  K'B)vo  =  K'xo. 

(3.14) 

Next,  forming  B‘^(3.11)B  yields 

0  =B'^A'^PB  +  B'^PAB  +  B'^RB  -  {B'^PA+  B"^ R)B{B'^ RB)' 

■^P'^(A'^PP  +  PP) 

=  -  B'^PAB{B'^RB)-^B'^A^PB, 

which  implies  that 

B-PAB  =  0,  B'^A'^PB  =  0. 

(3.15) 

Next,  form  (3.11)P  and  use  (3.15)  to  obtain 

0  =  P^PA,  0  =  A^PP, 

(3.16) 

which  is  a  stronger  condition  than  (3.15).  Now  using  (3.16)  and  (o.lO)  it  follows  that 

K'B  =  -{B'^RB)-'^B'^{A^P+R)B  =  ~Im. 


Hence 


I^  +  K'B  =  0, 

(3.17) 

which,  with  (3.14),  implies 

K'xq  =  0. 

(3.18) 

Now  using  (3.10)  and  (3.18)  we 

obtain 

P'^(A'^P  +  P)xo=0, 

(3.19) 

while  forming  (3.11)xo  yields 

uO={A’^P  +  PA+R)xo. 

(3.20) 
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Next,  it  is  useful  to  recognize  the  presence  of  two  idempotent  matrices.  First,  define  the  matrix 
p  e  by 

p  =  b{b’^rb)-^b'^r, 

which  is  idempotent  since  p*  =  p.  Note  that  pB  =  B  and  Rp  =  p’^R.  Since  rank  B  =  mv/e  have 
m  =  rank  B  =  rank  pB  <  rank  p  <  rank  B  =  m.  Hence  rank  p  =  m  <  n.  The  complementary 
projection  px  defined  by 

Px  =  ln-P  =  ln- B{B’^RB)-^B'^R 

is  also  idempotent.  Note  that  rank  px  =  n  —  m  >  0,  rank  px  <  n,  and  p±B  =  0.  In  terms  of  p±, 
(3.12)  can  be  written  as 

0  =  pIa^P+PApx  +  R-  RB{B'^RB)-^B'^R  -  PAB{B’^RB)-^B'^A^P.  (3.21) 

We  can  rewrite  (3.^1)  as 

0  =  A'^P  +  PAo  +  Ro-  PAB{3’^RB)~^B'^A'^P,  (3.22) 

where 

Ao  =  Apx  =  A-  AB{B'^RB)-^B’^R,. 

Ro  4  Rpx  =  pIR  =  pIRpx  =  R-  RB{B’^RB)-^B'^R. 

Note  that  Rq  is  nonnegative  definite  and  that  det  Rq  =  (det  i?)det  pj.  =  0,  so  thSt  Rq  is  singular. 

We  can  also  define  the  matrix  jr  €  IR”’'"  by 

T  ^  -BK’ 

which  is  idemptotent  because  of  (3.17).  It  follows  from  (3.10)  that 

TT  =  p  +  <7,  (3.23) 

where 

<7  =  B{B'^RB)-^B'^A’^P. 

Using  (3.16)  we  obtain  cB  =  0  so  that 

ttB  =  pB  =  B.  .  (3.24) 

Hence  we  have  m  =  rank  B  =  rank  zrB  <  rank  a-  <  rank  B  <  m  so  that  rank  z  =  m.  Defining 

zx  =  In-^  =  In  +  BK', 


12 


we  see  that  rank  ttx  =  n  —  m  and  '!r±B  =  0.  Also  we  see  that 

crp  =  0,  par  =  a,  =  0,  (3.25) 

itxq  =  0,  JTx^o  =  xo,  pxo  =  —axQ.  (3.26) 

Next  note  that  the  closed-loop  system  (3.6),  (3.9)  is  given  by 

i  =  A'z,  z(0)  =  Xo  —  Bvq,  (3.27) 

where 

A'  =  A-i-ABK'. 

However,  note  that 

AJ  =  A{r„  -i-  BK‘)  =  Attj..  (3.28) 

Since 

det  A‘  =  (det  A)(det  Xx)  =  0,  (3.29) 

it  follows  that  the  closed-loop  dynamics  matrix  A'  is  not  stable  even  if  A  is  nonsingular-  Also  note 
that 

Azd  =  Axo-  (3.30) 


Hence  we  conclude  that  the  feedback  control  v  =  K'z  given  by  (3.10)  does  not  stabilize  the 
transformed  system  even  under  the  assumptions  {A,AB)  stabilizable  and  (A,  72=)  detectable.  To 
see  why  this  is  plausible  in  view  of  standard  results  [89,91,92],  w'e  first  note  that  (Ao,AB)  is 
stabilizable  if  and  only  if  (A,  AB)  stabilizable.  Next,  note  that  by  the  PBH  test  with  A  s=  0  we 
have 

Rpx 

Hence  (Ao,  Bq)  is  not  detectable.  Thus,  by  [89],  at  best  we  can  expect  Re  A(A')  <  0  corresponding 
to  the  maximal  solution  to  the  Goh-Riccati  equ%tion  if  A  has  eigenvalues  on  the  imaginary  axis. 
The  lack  of  closed-loop  stability,  however,  goes  much  deeper  since  (3.29)  shows  that  det  A'  is 
unstable  even  if  A  is  stable,  that  is,  if  the  open-loop  system  is  stable. 

Transforming  back  to  the  original  system  we  have 


<  rank  px  =  n  —  m<n. 


(3.31) 


u  =  u  =  K*z  =  K’ Ax, 


(3.32) 
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so  that  the  control  u  is  given  by  u  =  Kx  with 


K  =  K'A  =  +  R)A. 

(3.33) 

Hence  the  original  closed-loop  system  consisting  of  (3.1)  and  (3.5)  has  the  form 

X  =  Ax^ 

(3.34) 

where 

A  =  A+BK  =  A+BK'A. 

(3.35) 

Note  that 

i  =  (/„  +  BK')A  =  7rj.A. 

(3.36) 

Comparing  (3.36)  to  (3.28),  we  see  that  the  original  closed-loop  system  has  the  same  closed-loop 
poles  as  the  treinsformed  system.  Hence  the  original  system  is  also  not  stabilized. 

As  a  simple  example  of  the  preceding,  consider  the  case  n  =  m  =  1,  A  ^  0,  B  ^  0,  Ri  >  0. 
Then  the  Goh-Riccati  equation  is  satisfied  only  by  P  =  0  and  thus  K'  =  ^  and  if  =  — -g.  Thus 
A'  =  A  -h  ABK'  -  0  and  A  =  A  +  BK'A  =  0.  Of  course,  for  this  problem  a  smooth  minimizing 
control  does  not  exiSt.  Hence  note  that  if  A  is  nonsingular,  then  (3.16)  implies 

0  =  B'^P,  0  =  PB. 

(3.37) 

Using  Sylvester’s  inequelity  we  •'btain 

rank  +  rank  P  —  n<  rank  B^P  =  0 

which  yields 

rank  P  <n~  m. 

(3.38) 

If  B'^RB  =  0,  then  Goh’s  transformation  can  be  repeated.  In  this  case  RB  = 

=  0.  Defining 

71  (t)  =  z{t)  -  Bvi{t),  vi(t)  =  f  v{s)  ds  +  vio, 

Jo 

(3.39) 

leads  to 

zi  —  A^i  -H  A^Bvi. 

(3.40) 

Assuming  now  that  B'^A'^RAB  is  positive  definite,  it  follows  that  ui  =  K"zi  is 

given  by 

K"  =  -{B'^A'^RAB)-'3'^A'^iA'^P  +  R), 

(3.41) 
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where  P  satisfies 


0  =  A’^P  +  PA  +  R-{A'^P  +  R)'^A  3'^A'^RAB)-'^B'^A'^{A'^P  +  R).  (3.42) 

For  the  origincJ  system,  u=  Kx  is  satisfied  with 

K  =  (3.43) 


4.  Perturbation  Approach 

The  purpose  of  this  section  is  to  provide  an  alternative  and  completely  distinct  derivation  of 
the  Goh-Riccati  equation.  The  derivation  is  based  upon  the  perturbation  expansion  technique 
pioneered  in  [30]  and  further  developed  in  [74] . 

To  begin,  consider  the  nonsingular  linear-quadratic  regulator  problem  with  Ri  =  R,  Rn  =  0, 
and  R2  =  £^Im  so  that  K  =  — i2j^S‘^P(e)  with  P(e)  given  by 


0  =  A'^P(e)  +  P(c)A  +  R-  4p(e)BSTp(e). 

(4.1) 

Expanding 

P(€)  =  Po  +  cPi  +  e^P2  H - 

(4.2) 

and  substituting  (4.2)  into  (4.1),  we  have 

0  =  A^(Po  -j-  ePi  -b  c^P2  +  •  •  •)  +  {Po  +  P2  +  •  •  ’)R 

-  -^(Po  -f-  ePi  +  e^Pi  +  •  •  •)SST(Po  +  ePi  -b  e^Pj  +  •••)• 

(4.3) 

Terms  of  order  e“^  yield 

0  =  PoPS^Po, 

(4.4) 

of  order  yield 

0  =  PoPB'^Pi-bPiPP'^Po, 

(4.5) 

and  of  order  yield 

0  =  A^Po  -b  PoA  -b  P  -  PiBB'^Pi  -  PoBB'^Pi  -  P^BB'^Pq. 

(4.6) 

Note  that  (4.4)  is  equivalent  to 

P^Po  =  0 

(4.7) 
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so  that  (4.5)  holds  for  arbitrary  Pi.  Next  using  (4.7)  in  (4.6)  implies 


0  =  A'^Po  4-  PoA  +  B  -  PiBB'^Pi. 

(4.8) 

Next  forming  B‘^(4.8)B  and  using  (4.7)  yields 

0  =  B'^BB  -  B'^'PiBB'^PiB, 

that  is, 

B'^BB  =  {B'^PiB^ 

(4.9) 

or 

(B'^BB)^  =  B'^PiB. 

(4.10) 

Hence  if  B'^RB  is  positive  definite,  then  so  is  B^P^B.  Next  form  P’^(4.8)  to  obtain 

0  =  B'^A'^Po  +  B'^PoA  +  B'^Bi  -  B'^PiBB'^Pi 
=  BT(A'^Po  +  B)  -  (B'^BB)»BTPi 

so  that 

B^Pi  =  (B‘^BB)-*B'^(A‘^Po  +  R).  (4.11) 

Substituting  (4.11)  into  (4.8)  now  yields 

0  =  A'^Po  +  PoA  +  Bi  -  (A'^Po  +  B)^B(B'^BB)-iB'r(A'^Po  +  B),  (4.12) 

which  is  identical  to  (3.11),  that  is,  the  Goh-Riccati  equation.  Note  that  condition  (4.7)  is  identical 
to  (3.37)  which  was  obtained  under  the  assumption  that  A  is  nonsingular. 

5.  Generalized  Legendre-Clebsch  Conditions 

The  generalized  Legendre-Clebsch  necessary  condition  was  first  proved  for  scalar  control  in 
[8,12,13]  and  later  for  vector  controls  in  [9,21]  This  condition  states  that  if  (a:,u)  is  optimaJ,  then 

=  0,  t  >  0,  (5.1) 

where  p  is  an  odd  positive  integer,  and 

d  d^’ 

{-l)’g^-3Pjir„(i(0,«(i),A(0)>0,  t>0,  (5.2) 
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where  7  is  a  positive  integer.  In  (5.1)  and  (5.2),  H  is  the  Hamiltonian  associated  with  the  problem 
and  A(*)  is  an  adjoint  variable  corresponding  to  the  optimal  pair  (a;,u). 


In  this  section  we  apply  condition  (5.2)  with  g  =  1  to  the  problem  consisting  of 


i  =  Ax  +  Bu,  x(0)  =  xq, 

(5.3) 

with  cost  functional 

pQO 

J(u,xo)  =  /  x'^Rxdt. 

Jo 

(5.4) 

Note  that  this  problem  is  normal  since  the  final  state  endpoint  is  free.  Hence  the  Lagrange  multiplier 
associated  with  the  cost  can  be  set  to  unity.  Applying  (5.2)  we  obtain 

(5.5) 

where 

H{x,u,X)  =  A’^(Ax+  J3u)  +  ^x'^Rx 

(5.6) 

and 

~X{t)  —  H^{x{t)yu{t),X{t))  =  J?x(t)  +  AA(t). 

(5.7) 

Evaluating  the  left  hand  side  of  (5.5)  we  obtain 

=  x'^{t){RA  -  A'^R)B  +  A'^(f)A*B  -  u’^{t)B'^RB. 

Thus  (5.5)  implies  that 

B'^RB  >  0. 


(5.8) 


(5.9) 


If  {x,u)  is  optimal  for  the  optimal  control  problem,  then  {x{t),u{t)yX{t))  satisfies,  in  addition 
to  the  adjoint  equation,  the  minimality  condition  of  the  Pontryagin  minimum  principle,  that  is. 


H{x{t],u,X{t))  =  H{x{t),u{t),X{t)),  t  >  0, 

u^IR 


which  implies 

Now  (5.11)  yields 


ff„(®(«),u(«),A(t))  =  A^(f)B  =  0,  t>0. 


— if„(a:(t),u(t),A(f))=0,  t  >  0, 


(5.10) 

(5.11) 

(5.12) 


it 


which  implies 

x'^{t)RB  +  X'^{t)AB  =  0,  t>0.  (5.13) 

Furthermore,  (5.12)  implies 

-|jF„(x(i),u(t),A(t))  =  0,  t>0,  (5.14) 

which,  by  (5.8)  is  equivalent  to 

B'^RBu{t)  =  B'^(A'^R  -  RA)x{t)  +  B'^A^'^X{t).  (5.15) 


Assuming  now  that  the  strengthened  Legendre-Clebsch  condition  holds,  that  is,  B'^RB  >  0, 
(5.15)  implies 

u(t)  =  (B'^iJB)-^5'^[(A^i?  -  i2A)a:(i)  +  A2TA(t)],  ,  (5.16) 

which  is  equation  (8.2.28),  p.  251,  of  [43|. 


Next,  substituting  (5.16)  into  (5.1)  and  using  (5.7)  leads  to  the  linear  system 


x(t)l 

[m 


A  +  B{B'^RB)-'^B'^{A'^R  -  RA)  B{B'^RB)-^B'^A^'^ 
-R  -A'T 


x{t) 

X{t) 


(5.17) 


Consider  the  matrix  systemjcorresponding  to  (5.14),  that  is,  where  x  and  A  are  replaced  respectively 
by  n  X  n-matrix  functions  Af  and  A.  If  Af  is  invertible,  define  as  in  [97) 


W  =  AX-'^, 


(5.18) 


which  satisfies  Wx  =  X  and 
W  =  AAf-^  -  AX-^XX'^ 

(5.19) 

=  -R-  A'^W  -W[A+  B{B'^RB)-^3'^{A^R  -  RA)]  -  W BiB"^ RB)-'^B'^A^'^W. 

Now  consider  the  steady-state  case  W  =  0,  that  is,  W (t)  =  Wo  =  constant.  Then  Wq  satisfies 

0  =  A'^Wo  +  Wo[A  -h  B{B'^RB)-^B'^{A'^R  -  RA)]  -h  WoB{B'^RB)-'^B'^A‘^'^Wq.  (5.20) 

Under  the  zissumption  that  A  is  nonsingular,  define 

P  =  -{A'^Wo  +  R)A-^,  (5.21) 


so  that 

14^0  =  -A-'^(A'^F  -i- 


(5.22) 
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By  Lemma  2.1  and  Lemma  2.3  it  follows  that  xo  €  Z{Q)  for  each  nonnegative-definite  solution 
Q  of  (6.5).  Hence  (6.6)  implies 

B'^Pxo  =  0.  (6.9) 

Alternatively,  (6.9)  can  be  obtained  by  forming  B'^P{6.8)PB  and  using  (6.6).  Next,  forming 
Q{6.7)Q  yields 

0  =  Q{A'^P  +  PA  +  R)Q  (6.10) 

and  hence 

0  =  x'S{A'^P  +  PA+R)xo.  (6.11) 


Next,  consider  the  minimal  nonnegative-definite  solution  to  (6.4)  given  by 


/•oo  .» 

P=  *Re'^^dt. 

'  Jq 

Letting  e  >  0,  e  «  0,  (6.12)  can  be  written  as 

too 

^Re'^^  dt  +  I  dt 


=  l\{In  +  0{t))\R[In  +  0(t))-dt  +  dt 

/<»  -X 


(6.12) 


(6.13). 


Hence 

B'^PB  =  eB'^RB  -1-  0(€*),+  ^  dtB.  (6.14) 

Letting  e  >  0  be  sufficiently  small  it  follows  from  (6.14)  that  if  B’^RB  is  positive  definite,  then 
B'^PB  is  also  positive  definite. 

As  in  Section  3,  we  assume  B'^RB  is  positive  definite.  Since  B’^PB  must  be  positive  definite, 
it  follows  that 

rank  PB  =  m.  (6.15) 


Now  (6.6)  implies  that 

rank  Q  <n  —  m.  (6.16) 

Hence  Q  cannot  be  positive  definite. 

Now  form  B'^P{6.8)  and  use  (6.6)  and  (6.9)  to  obteiin 

0  =  B'^P(A-hBJr)Q,  (6.17) 
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which  implies 


KQ  =  -{B'^PB)-^B’^PAQ.  (6.18) 

Furthermore,  forming  B'^{6.7)Q  and  using  (6.6)  and  (6.18)  yields 

0=  5^(A'^P  +  i?)(3.  (6.19) 


Arguing  as  in  Section  2  we  can  take 

K  =  -{B'^PB)-^B'^PA. 

With  K  given  by  (6.20)  the  closed-loop  dynamics  matrix  becomes 

A  = 


where  u±  £  is  defined  by 

u  =  B{B'^PB)-^B'^P,  vx  =  In-  V. 


Note  that  v  satisfies 


(6.20) 


(6.21) 


=  V,  rank  v  =  m,  rank  vx  =  n  -  m,  (6.22) 

vB  =  B,  uxB  =  0,  Pu  =  (6.23) 

uQ  =  0,  Q  =  uxQt^x  =  ^-i-Q  =  Q^x-  (6.24) 

Also,  define 

P'  ^  Pvx  =  vlP  =  ulPux  =  P-  PB{B’^PB)-^B’^P.  (6.24) 

Next,  using  (6.21)  in  (6.4)  and  (6.5)  yields 

0  =  +  PvxA  +  P,  (6.25) 

0  =  uxAQ  -1-  QA'^i'x  +  ^0^0-  (6.26) 

Note  that  (6.25)  can  be  written  as 

0  =  A’^P'-J-P'A  +  P.  (6.27) 


However,  both  (6.25)  and  (6.27)  are  wrong!  Using  (6.18)  rather  than  (6120)  in  (6.4)Q  yields 


0  =  (A^P'  +  P'A-1-P)Q. 


,(6.28) 
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Next,  note  that  since  Z{AQ)  C  R.{Q),  it  follows  that  B'^PA’‘Q  =  0  for  r  >  0.  Using  this  fact 
and  forming  B'^{6.4)AQ  and  solving  for  KQ  yields 

KQ  =  -{B'^RB)-^B'^{A^PA  +  RA)Q.  .  (6.29) 

Now  assuming  A  is  nonsingular  wo  see  that 

P'  =  A-’^A^PAA-^  (6.30) 

and 

KQ  =  -{B'^RB)-^B’^{A'^P'  +  R)AQ.  (6.31) 

Next  define 

A'  =  AAA~'^,  R'  =  A-'^A^RAA-^, 
and  form  A"^A’^(6.4)AA“^  to  obtain 

0  =  +  P’A’  +  R'.  (6.32) 

Since  K  operates  on  the  reachable  set  of  the  closed-loop  system,  take 

K  =  -(S^i2B)“^B'^(A^P'  +  R)A,  (6.33) 

which  is  identical  to  (3.33)  with  P  replaced  by  P'.  From  (6.33)  we  have. 

BKA-^  =  -B{B'^RB)-^B'^{A'^P'  +  R).  (6.34) 

Then  A'  and  R'  can  be  written  as 

A' =  A+  ABKA-^  =  A-  AB{B'^ RB)-^B'^{A’^P'  +  R),  (6.35) 

P'  =  (/+  BKA-YR{j[+BKA-^) 

=  [I-  B{B’^RB)-^B’^{A'^P'  -f-  P))'^P(/  -  B(P'^PB)-^S^(A'^P'  +  P)].  (6.36) 

Now,  with  (6.35)  and  (6.36),  equation  (6.26)  becomes 

0  =  A^P'  +  P'A  +  P  -  (A'^P'  +  P)‘^P(P'^PB)-^PT(A'^P'  +  P).  (6.37) 

Note  that  (6.37)  is  the  Goh-Riccati  equation  (3.11)  with  P  replaced  by  P'. 
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Finally,  comparing  (6.21)  to  (3.26)  we  see  that 

A  =  ir±A  =  v±A.  (6.38) 

If  A  is  nonsingular  (6.38)  implies 

ff  =  I/.  (6.33) 

We  can  show  this  directly.  It  is  easy  to  see  that 

B  =  vB  =  TtB  =  iruB  =  0,  vQ  =  TtQ  =  7n/±Q  =  0, 


which  does  not  suffice,  however. 

Remark  6.1.  In  the  case  of  a  higher-order  singularity,  assume  B’^RB  =  0.  Then  B'^R  =  0 
and'RB  =  0.  Hence 

B'^PB  =  f\l+  At  +  Oit^)fR[I+At  -h  0(i*)j  dtB  f  dtB 

=  j^[t^A'^RA  +  0(t®)]  dtB  +  B'^  dtB 

=  jB'^A'^RAB  +  0(€^)  +.B'^  dtB, 

which  shows  that  if  B'^A’^RAB  is  positive  definite,  then  so  is  B'^PB. 


Acknowledginent.  The  authors  thank  Prof.  Y.  Halevi  for  helpful  discussions  concerning  this 
paper. 


23 


References 

1.  D.  F.  Lawden,  “Optimal  Powered  Arcs  in  an  Inverse  Square  Law  Field,”  J.  Amer^  Rocket  Soc., 
Vol.  31,  pp.  566-568,  1961. 

2.  D.  F.  Lawden,  “Optimal  Intermediate-Thrust  Arcs  in  a  Gravitational  Field,”  Acta  Astronau- 
tica,  Vol.  8,  pp.  106-123,  1962. 

3.  D;  F.  Lawden,  Optimal  Trajectories  for  Space  Navigation,  Butterworth,  1963. 

4.  C.  D.  Johnson  and  J.  E.  Gibson,  “Singular  Solutions  in  Problems  of  Optimal  Control,”  IEEE 
Trans.  Autom.  Gontr.,  Vol.  AC-8,  pp.  4-15, 1963. 

5.  H.  J.  Kelley,  “Singular  Extremals  in  Lawden’s  Problem  of  Optimal  Rocket  Flight,”  AIAA  J., 
Vol.  1,  pp.  1578-1580,  1963. 

6.  H.  J.  Kelley,  “A  Transformation  Approach  to  Singular  Subarcs  in  Optimal  TVajectory  and 
Control  Problems,”  SIAM  J.  Gontr.,  Vol.  2,  pp.  234-240,  1964. 

7.  W.  M.  Wonham  and  C.  D.  Johnson,  “Optimal  Bang-Bang  Control  with  Quadratic  Performance 
Index,”  Trans.  ASME  J.  Basic  Eng.,  Vol.  86,  pp.  107-115,  1964. 

8.  H.  J.  Kelley,  “A  Second  Variation  Test  for  Singular  Extremals,”  AIAA  J.,  Vol.  2,  pp.  1380- 
1382, 1964. 

9.  D.  R.  Snow,  “Singular  Optimal  Controls  for  a  Class  of  Minimum  Effort  Problems,”  SIAM  J. 
Gontr.,  Vol.  2,  pp.  203-219, 1964. 

10.  H.  Hermes,  “Controllability  and  the  Singular  Problem,”  SIAM  J.  Gontr.,  Vol.  2,  pp.  241-260, 

1964. 

11  M,  Athans  and  M.  D.  Cannon,  “On  the  Fuel  Opfimar Singular  Control  of  Nonlinear  Second- 
Order  Systems,”  IEEE  Trans.  Autom.  Gontr.,  Vcl.  AC-9,  pp.  360-370,  T964. 

12.  K.  S.  Tait,  Singular  Problems  in  Optimal  Gontrol,  Ph.D.  Dissertation,  Harvard  University, 
Cambridge,  Mass.,  1965. 

13.  R.  E.  Kopp  and  H.  G.  Moyer,  “Necessary  Conditions  for  Singular  Extremals,”  AIAA  J.,  Vol. 
3,  pp.  1439-1444,  1965. 

14.  C.  D.  Johnson,  “Singular  Solutions  in  Optimal  Control  Problems,”  in  Advances  in  Gontrol 
Systems  -  Theory  and  Applications,  Vol.  2,  C.  T.  Leondes,  Ed.,  pp.  209-267,  Academic  Press, 

1965. 

15.  H.  M.  Robbins,  “Optimality  of  Intermediate-Thrust  Arcs  of  Rocket  Trajectories,”  AIAA  J., 
Vol.  3,  pp.  1094-1098,  1965. 

16.  J.  V.  Breakwell,  “A  Doubly  Singular  Problem  in  Optimal  Interplanetary  Guidance,”  SIAM  J. 
Gontr.,  Vol.  3,  pp.  71-77,  1965. 

17.  R.  A.  Rohrer  and  M.  Sobral,  Jr.,  “Optimal  Singular  Solutions  for  Linear  Multi-Input  Systems,” 
Trans.  ASME  J.  Basic  Eng.,  pp.  323-328,  1966. 

18.  B.  S.  Goh,  “The  Second  Variation  for  the  Singular  Bolza  Problem,”  SIAM  J.  Gontr.,  Vol.  4, 
pp.  309-325,  1966. 


24 


19.  B.  S.  Goh,  “Necessary  Conditions  for  Singular  Extremals  Involving  Multiple  Control  Variables,” 
SIAM  J.  Gontr.,  Vol.  4,  pp.  716-731,  1966. 

20.  B.  S.  Goh,  “Optimal  Singular  Control  for  Multi-Input  Linear  Systems,”  J.  Math.  Anal.  Appl., 
Vol.  20,  pp.  534-539,  1967. 

21.  H.  M.  Robbins,  “A  Generalized  Legendre- Clebsch  Condition  for  the  Singular  Cases  of  Optimal 
Control,”  IBM  J.  Res.  Dev.,  Vol.  3,  pp.  361-372,  1967. 

22.  H.  J.  Kelley,  R.  E.  Kopp,  and  H.  G.  Moyer,  “Singular  Extremals,”  in  Topics  in  Optimization, 
G.  Leitmann,  Ed.,  pp.  63-101,  Academic  Press,  1967. 

23.  R.  F.  Webber  and  R.  W.  Bass,  “Simplified  Algebraic  Characterization  of  Optimal  Singular 
Control  for  Autonomous  Linear  Plants,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-12,  pp.  743- 
746,  1967. 

24.  S.  Butman,  “A  Method  for  Optimizing  Control-Free  Costs  in  Systems  with  Linear  Controllers,” 
IEEE  Trans.  Autom.  Contr.,  Vol.  AC-13,  pp.  554-556,  1968. 

25.  D.  H.  Jacobson,  “A  New  Necessary  Condition  of  Optimality  for  Singular  Control  Problems,” 
SIAM  J.  Contr.,  Vol.  7,  pp.  578-595,  1969. 

26.  D.  H.  Jacobson,  “Sufficient  Conditions  for  Nonnegativity  of  the  Second  Variation  in  Singular 
and  Nonsingular  Control  Problems,”  SIAM  J.  Contr.,  Vol.  8,  pp.  403-423,  1970. 

27.  D.  H.  Jacobson,  “On  Conditions  of  Optimality  for  Singular  Control  Problems,”  IEEE  Trans. 
Optim.  Contr.,  Vol.  15,  pp.  109-110,  1970. 

28.  J.  P.  McDanell  and  W.  F.  Powers,  “New  Jacobi-Type  Necessary  and  Sufficient  Conditions  for 
Singular  Optimization  Problems,”  AIAA  J.,  Vol.  8,  pp.  1416-1420,  1970. 

29.  J.  P.  McDanell  and  W.  F.  Powers,  “Necesseury  Conditions  for  Joining  Optimal  Singular  and 
Nonsingular  Subzircs,”  SIAM  J.  Contr.,  Vol.  9,  pp.  161-173,  1971. 

30.  B.  Friedlcind,  “Limiting  Forms  of  Optimum  Stochastic  Linear  Regulators,”  Trans.  ASME,  Vol. 
93,  pp.  134-141,  1971. 

31.  P.  J.  Moylan  and  J.  B.  Moore,  “Generalizations  of  Singular  Optimal  Control  Theory,”  Auto- 
matica,  Vol.  7,  pp.  591-598,  1971. 

32.  J.  L.  Speyer  and  D.  H.  Jacobson,  “Necessary  and  Sufficient  Conditions  for  Optimality  for 
Singular  Control  Problems:  A  Transformation  Approach,”  J.  Math.  Anal.  Appl.,  Vol.  33,  pp. 
163-187,  1971. 

33.  D.  H.  Jacobson  and  J.  L.  Speyer,  “Neccessary  and  Sufficient  Conditions  for  Optimality  for 
Singular  Control  Problems:  A  Limit  Approach,”  J.  Math.  Anal.  Appl.,  Vol.  34,  pp.  239-266, 
1971. 

34.  D.  H.  Jacobson,  “Totally  Singular  Quadratic  Minimization  Problems,”  IEEE  Trans.  Autom. 
Contr.,  Vol.  AC-16,  pp.  651-658,  1971. 

35.  H.  Kwakernaak  and  R.  Sivan,  “The  Maximally  Achievable  Accureicy  of  Linear  Optimal  Filters,” 
IEEE  Trans.  Autom.  Contr.,  Vol.  AC-17,  pp.  79-86,  1972. 


25 


36.  H.  Kwakernaak  eind  R.  Sivan,  Linear  Optimal  Control  Systems,  Wiley,  1972. 


37.  R.  Gabasov  and  F.  M.  Kirillova,  “High  Order  Necessary  Conditions  for  Optimality,”  SIAM  J. 
Contr.,  Vol.  10,  pp.  127-168,  1972. 

38.  Y.-C.  Ho,  “Linear  Stochastic  Singular  Control  Problems,”  J.  Optim.  Thy.  Appi,  Vol.  9,  pp. 
24-31,  1972. 

39.  B.  D.  O.  Anderson,  “Partially  Singular  Linear-Quadratic  Control  Problems,”  IEEE  Trans. 
Autom.  Contr.,  Vol.  AC-18,  pp.  407-409,  1973. 

40.  M.  F.  Hutton,  “Solution  of  the  Singular  Stochastic  Regulator  Problem,”  Trans.  ASMS,  VoL 
95,  pp.  414-417,  1973. 

41.  C.  Marchal,  “Chattering  Arc  and  Chattering  Controls,”  J.  Optim.  Thy.  Appl.,  Vol.  11,  pp. 
441-468,  1973. 

42.  J.  B.  Moore,  “The  Singular  Solutions  to  a  Singular  Quadratic  Minimization  .Problem,”  Int.  J. 
Contr.,  Vol.  20,  pp.  383-393,  1974. 

43.  H.  G.  Kwatny,  “Minimal  Order  Observers  and  Certain  Singular  Problems  of  Optimal  Estima¬ 
tion  and  Control,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-19,  pp.  274-276,  1974. 

44.  D.  J.  Bell  and  D.  H.  Jacobson,  Singular  Optimal  Control  Problems,  Academic  Press,  1975. 

45.  A.  E.  Bryson,  Jr.,  and  Y.-C.  Ho,  Applied  Optimal  Control,  Wiley,  1975. 

46.  V,  B.  Haas,  “On  Normality  and  Conjugate  Point  Criteria  for  Singular  Extremals,”  SIAM  J. 
Contr.,  Vol.  13,  pp.  1172-1182,  1975. 

47.  A.  J2imeson  and  R.  E.  O’Malley,  “Cheap  Control  of  the  Time-Invarieint  Regulator,”  Appl. 
Math.  Optim.,  Vol.  1,  pp.  .337-354,  1975. 

48.  C.  Marchal,  “Second-Order  Tests  in  Optimization  Theories,”  J.  Optim.  Thy.  Appl.,  Vol.  15, 
pp.  633-666,  1975. 

49.  R.  E.  O’Malley,  Jr.,  and  A.  Jameson,  “Singular  Perturbations  and  Singular  Arcs  -  Part  I," 
IEEE  Trans.  Autom.  Contr.,  Vol.  AC-20,  pp.  218-226,  1975. 

50.  R.  E.  O’Malley,  Jr.,  “A  More  Direct  Solution  of  the  Nearly  Singular  Linear  Regulator  Problem,” 
SIAM  J.  Contr.  Optim.,  Vol.  14,  pp.  1063-1077,  1976. 

51.  S.  L.  Campbell,  “Optimal' Control  of  Autonomous  Linear  Processes  with  Singular  Matrices  in 
the  Quadratic  Cost  Functional,”  SIAM  J.  Contr.  Optim.,  Vol.  14,  pp.  1092-1106,  1976. 

52.  T.  Nakamizo  and  M.  Oshiro,  “On  Stochastic  Singular  Problem  of  Linear  Dynamical  System,” 
in  Stochastic  Problems  in  Dynamics,  B.  L.  Clarkson,  Ed.,  pp.  116-137,  Pitman,  1977. 

53.  R.  E.  O’Malley,  Jr.,  and  A.  Jameson,  “Singular  Perturbations  and  Singular  Arcs  -  Part  II,” 
IEEE  Trans.  Autom.  Contr.,  Vol.  AC-22,  pp.  328-337,  1977. 

54.  A-  J-  Krener,  “The  High  Order  Maximum  Principle  and  Its  Applications  to  Singular  Ex¬ 
tremals,”  SIAM  J.  Contr.,  Vol.  15,  pp.  256-293, 1977. 

55.  V.  B.  Haas,  “On  the  Singular  Bolza  Problem,”  Adv.  Math.,  Vol.  24,  pp.  189-205,  1977. 


26 


56.  D.  J.  Clements,  B.  D.  O.  Anderson,  and  P.  J.  Moylan,  “Matrix  Inequality  Solution  to  Line^ 
Quadratic  Singular  Control  Problems,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-22,  pp.  55-57, 
1977. 

57.  D.  J.  Clements  and  B.  D.  O.  Anderson,  “TVansformational  Solutions  of  Singular  Linear- 
Quadratic  Control  Problems,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-22,  pp.  57-60, 1977. 

58.  D.  J.  Clements  and  B.  D.  O.  Anderson,  Singular  Optimal  Control:  The  Linear  Quadratic 
Problem,  Springer,  1978. 

59.  V.  B.  Hcias,  “The  Clebsch  and  Jacobi  Conditions  for  Singular  Extremals,”  Int.  J.  Contr.,  Vol. 
27,  pp,  557-570,  1978. 

60.  B.  A.  Francis  and  K.  Glover,  “Bounded  Peaking  in  the  Optimal  Linear  Regulator  with  Cheap 
Control,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-23,  pp.  608-617,  1978. 

61.  B.  A.  F  's  ,  “The  Optimal  Linear-Quadratic  Time-Invariant  Regulator  with  Cheap  Control,” 

IEEE  .3.  Autom.  Contr.,  Vol.  AC-24,  pp.  616-621,  1979. 

62.  J.  Grasman,  “Nonuniqueness  in  Singular  Optimal  Control,”  Proc.  Int.  Symp.  MTNS,  Vol.  3, 
pp.  415-420,  1979. 

63.  R.  Bortins,  N.  M.  Boustany,  and  W.  F.  Powers,  “The  Infinite-Order  Singular  Problem,”  Optim. 
Contr.  Appl.  Meth.,  Vol.  1,  pp.  279-302,  1980. 

64.  C.  Marchal  and  P.  Contensou,  “Singularities  in  Optimization  of  Deterministic  Dynamic  Sys¬ 
tems,”  AIAA  J.  Quid.  Contr.,  Vol.  4,  pp.  240-252,  1981. 

65.  V.  Dragan  and  A.  Halanay,  “Cheap  Control  and  Singularly  Perturbed  Matrix  Riccati  Differ¬ 
ential  Equations,”  Rev.  Roum.  Math.  Pures  Appl.,  Vol.  26,  pp.  21-40,  1981. 

66.  V.  B.  Haas,  “The  Singular  Steady  State  Linear  Regulator,”  SIAM  J.  Contr.’ Optim.,  Vol.  20, 
pp.  247-257,  1982. 

67.  V.  B.  Haas,  “On  Optimal  Controls  Having  Finite  Order  of  Singularity,”  Report  LIDS-P-1340, 
MIT,  1982  (unpublished). 

68.  J.  M.  Schumacher,  “The  Role  of  the  Dissipation  Matrix  in  Singular  Optimal  Control,”  Sys. 
Contr.  Lett.,  Vol.  2,  pp.  262-266,  1983. 

69.  J.  O’Reilly,  “Peirtial  Cheap  Control  of  the  Time-Invariant  Regulator,”  Int.  J.  Contr.,  Vol.  37, 
pp.  909-927,  1983. 

70.  P.  Sannuti,  “Direct  Singular  Perturbation  Analysis  of  High-Gain  emd  Cheap  Control  Problems,” 
Automatica,  Vol.  19,  pp.  41-51, 1983. 

71.  M.  L.  J.  Hautus  and  L.  M.  Silverman,  “System  Structure  and  Singular  Control,”  Lin.  A-y. 
Appl.,  Vol.  50,  pp.  369-40^,  1983. 

72.  V.  V.  Gorokhovik,  “High-Order  Necessary  Optimality  Conditions  for  Control  Problems  with 
Terminal  Constraints,”  Optim.  Contr.  Appl.  Meth.,  Vol.  4,  pp.  103-127, 1983. 

73.  J.  C.  Willems,  A.  Kitapci,  and  L.  M.  Silverman,  “Singular  Optimal  Control:  A  Geometric 
Approach,”  SIAM  J.  Contr.  Optim.,  Vol.  24,  pp.  323-337,  1986. 


27 


74.  Y.  Halevi  and  Z.  J.  Palmor,  “Extended  Limiting  Forms  of  Optimum  Observers  and  LQG 
Regulators,”  Vol.  43,  pp.  193-212,  1986. 

75.  D.  S.  Bernstein,  “The  Optimal  Projection  Equations  for  Static  and  Dynamic  Output  Feedback. 
The  Singular  Case,”  JBEE  Trans.  Autom.  Contr.,  Vol.  AC-32,  pp.  1132-1143, 1987. 

76.  Y.  Halevi,  W.  M.  Haddad,  and  D.  S.  Bernstein,  “A  Riccati  Approach  to  the  Singular  LQG 
Problem,”  Proc.  Amer.  Contr.  Conf.,  pp.  2077-2078,.Pittsburgh,  PA,  June  1989. 

77.  T.  Geerts,  “Continuity  Properties  of  the  Cheap-Control  Problem  Without  Stability,”  Lin.  Alg. 
'Appl.,  Vol.  122/123/124,  pp.  65-104,  1989. 

78.  T.  Geerts,  “All  Optimal  Controls  for  the  Singular  Linear-Quadratic  Problem  Without  Stabilityj 
a  New  Interpretation  of  the  Optimal  Cost,”  Lin.  Alg.  Appl.,  Vol.  116,  pp.  135-181, 1989. 

79.  T.  Geerts,  “The  Algebraic  Riccati  Equation  and  Singular  Optimal  Control,”  Proc.  Workshop 
on  the  Riccati  Equation  in  Control,  Signals,  and  Systems,  Como,  Italy,  1989. 

80.  F.  Lamnabhi-Lagarrigue  and  G.  Stefani,  “Singular  Optimal  Control  Problems:  On  the  Neces¬ 
sary  Conditions  of  Optimality,”  SIAM  J.  Contr.  Optim.,  Vol.  28,  pp.  823-840, 1990. 

81.  T.  Geerts,  “All  Optimal  Controls  for  the  Singular  Linear-Quadratic  Problem  with  Stability; 
Related  Algebraic  and  Geometric  Results,”  preprint. 

82.  V.  Jurdjevic  and  I.  A.  K.  Kupka,  “Linear  Systems  with  Singular  Quadratic  Cost,”  preprint. 

83.  Y.  Halevi,  W.  M.  Haddad,  and  D.  S.  Bernstein,  “A  Riccati  Equation  Approach  to  the  Singular 
LQG  Problem,”  preprint. 

84.  W.  S.  Levine  and  M.  Athans,  “On  the  Determination  of  the  Optimal  Constant  Output  Feedback 
Gains  for  Linear  Multivariable  Systems,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-15,  pp.  44-48, 
1970. 

85.  D.  C.  Hyland  and  D.  S.  Bernstein,  “The  Optimal  Projection  Equations  for  Fixed-Order  Dy¬ 
namic  Compensation,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-29,  pp.  1034-1037, 1984. 

86.  D.  S.  Bernstein,  W.  M.  Haddad,  and  C.  N.  Nett,  “Minimal  Complexity  Control  Law  Synthesis, 
Part  2:  Problem  Solution  via  H2/H00  Optimal  Static  Output  Feedbadc,”  Proc.  Amer.  Contr. 
Conf.,  pp.  2506-2511,  Pittsburgh,  PA,  June  1989. 

87.  J.  Snyders  and  M.  Zakeii,  “On  Nonnegative  Solutions  of  the  E!quation  AD  -r  DA'  =  -C,”  SUM 
J.  Appl.  Math.,  Vol.  18,  pp.  704-714,  1970. 

88.  W.  M.  Wonham,  Linear  Multivariable  Control:  A  Geometric  Approach,  Springer,  1979. 

89.  R.  W.  Brockett,  Finite  Dimensional  Linear  Systems,  Wiley,  1970. 

90.  H.  K.  Wimmer,  “The  Algebraic  Riccati  Equation  Without  Complete  Controllability,”  SIAM 
J.  Alg.  Disc.  Meth.,  Vol.  3,  pp.  1-12, 1982. 

91.  H.  K.  Wimmer,  “The  Algebraic  Riccati  Equation.  Conditions  for  the  Existence  and  Uniqueness 
of  Solutions,”  Lin.  Alg.  Appl.,  Vol.  58,  pp.  441-452, 1984. 

92.  H.  K.  Wimmer,  “Monotonicity  of  Maximal  Solutions  of  Algebraic  IHccati  Ekiuations,”  Sys. 
Contr.  Lett.,  Vol.  5,  pp.  317-319, 1985- 


28 


93.  V.  Kucera,  “A  Contribution  to  Matrix  Qaudratic  Equations,”  IEEE  Trans.  Autom.  Contr., 
Vol.  AC-17,  pp.  344-347,  1972. 

94.  V.  Kucera,  “On  Nonnegative  Definite  Solutions  to  Matrix  Quadratic  Equations,”  Automatica, 
Vol.  8,  pp.  413-423,  1972. 

95.  I.  Gohberg,  P.  Lancaster,  and  L.  Rodman,  “On  Hermitian  Solutions  for  the  Symmetric  Alge¬ 
braic  Riccati  Equation,”  SIAM  J.  Contr.  Optim.,  Vol.  24,  pp.  1323-1334,  1986. 

96.  T.  Geerts,  “A.  Necessary  and  Sufficient  Condition  for  Solvability  of  the  Linear-Quadratic  Con¬ 
trol  Problem  Without  Stability,”  Sys.  Contr.  Lett.,  Vol.  11,  pp.  47-51,  1988. 

97.  W.  T.  Reid,  Riccati  Differential  Equations,  Academic  Press,  1972. 


29 


29th  CDC 


February  1990 

A  RICCATI  EQUATION  APPROCH  TO  THE  SINGULAR  LQG  PROBLEM 


by 


Yoram  Halevi 

Faculty  of  Mech.  Engineering 
Technion-Israel  Institute  of  Technology 
Haifa  32000, 

Israel 


Wassim  M.  Haddad 
Department  of  Mechanical  and 
Aerospace  Engineering 
Florida  Institute  of  Technology 
Melbourne,  FL  32902 


Dennis  S.  Bernstein 
Government  Aerospace 
System  Division 
Harris  Corporation, 
Melbourne,  FL  32902 


Abstract 

The  problem  of  optimal  fixed-order  dynamic  compensators  for  the  singular  LQG  problem  is 
considered.  Necessary  conditions  characterizing  the  optimal  compensator  for  the  most  general 
case,  i.e.  both  singular  measurement  and  singular  control  weighting  matrix,  are  given.  The 
solution  consists  of  a  set  of  two  algebraic  Riccati  equations  and  two  Lyapunov  equations  couples 
by  three  projection  matrices.  One  is  the  standard  order  reduction  projection  and  the  other  two 
reflect  the  tw  o  types  of  singularity  that  exists  in  the  system.  The  three  projections  are  shown  to 
satisfy  disjoinmess  conditions.  In  addition  to  order  reduction,  an  advantage  of  the  fixed-structure 
approach  is  that  differentiation,  which  is  often  undesirable  from  a  practical  point  of  view  and 
which  may  exist  in  the  unconstrained  optimal  control,  can  be  avoided.  The  fixed  order 
compensator  agrees  wilth  the  unconstrained  solution  when  the  latter  possesses  the  same  number 
of  differentiations  as  are  included  in  the  prespecified  controller  structure  and  when  the  order  is 
selected  appropriately. 


1.  INTRODUCTION 


The  singular  LQG  control  problem  has  been  of  considerable  interest  for  almost  two  decades 
([1-14]).  Such  problems  arise  when  some  of  the  measurements  are  noise  free  or  when  some  of  the 
control  signals  are  unweighted.  This  will  be  the  case,  for  example,  if  the  sensor  noise  is  colored  or 
if  acmator  dynamics  are  included.  Augmentation  of  the  plant  dynamics  by  means  of  noise  shaping 
filters  or  actuator  dynamics  thus  leads  directly  to  the  singular  problem  formulation. 

Most  of  the  literature  on  the  singular  LQG’  problem  is  based  upon  either  limiting  procedures 
in  which  suitable  weighting  matrices  and  noise  intensities  approach  zero,  or  differentiation  of 
noise-free  signals.  These  results  demonstrate  that  the  compensators  which  arise  in  the  limiting 
solution  may  include  differentiators.  The  dimension  of  the  optimal  compensators  depends  on  the 
order  of  singularity  of  the  problem,  but  in  general  the  sum  of  differentiators  and  integrators  is  equal 
to  the  dimension  of  the  system  minus  the  number  of  noise-free  measurements  (unweighted  control 
signals  in  the  dual  problem).  In  practical  applications,  however,  it  is  often  of  interest  to  determine 
the  optimal  controller  within  a  prespecified  class  of  controllers.  In  particular,  we  consider  the 
singular  LQG  problem  in  which  the  controller  is  preconstrained  to  possess  a  fixed  dynamic 
feedback  structure.  The  fixed  structure  includes  the  order  of  the  compensator  and  the  fact  that  it  is 
proper.  Hence  an  additional  benefit  of  our  approach  is  the  ability  to  impose  an  upper  bound  on  the 
number  of  differentiators  to  be  included  in  the  controller.  That  is,  while  cenain  measurement 
signals  may  be  noise-free  and  hence  differentiable,  it  may  be  undesirable  in  practice  to  implement 
more  than  one  level  of  differentiation  or,  perhaps  any  differentiation  at  ah. 

Preliminary  results  for  the  singular  LQG  problem  using  the  fixed  structure  approach  were 
obtained  in  [15],  The  results  there  are  incomplete,  however,  in  that  the  gains  associated  with 
certain  feedback  paths  were  not  given  explicitly.  For  the  corresponding  singular  estimation 
problem  ([18])  this  defect  was  remedied  in  [19]  where  all  feedback  gains  were  explicitly 
characterized.  In  addition,  the  solution  obtained  in  [19]  was  shown  to  agree  completely  with  results 
obtained  using  standard  limiting  methods  when  the  (unconstrained)  optimal  singular  estirnator  does 
not  possess  differentiators  ([20]).  The  results  of  [19]  thus  provide  for  certain  cases  an  alternative 
approach  to  the  singular  estimation  problem  considered  in  [20-23]  and  the  numerous  references 
therein.  Preliminary  and  partial  results  of  the  present  paper  were  reported  in  [16],  where  only  the 
case  of  singular  measurement  was  considered. 


The  contribution  of  the  present  paper  is  thus  to  complete  the  development  of  [15]  by 
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incorporating  the  methods  used  in  [19].  Accordingly,  we  derive  a  coupled  system  of  modified 
Riccati  and  Lyapunov  equations  which  explicitly  characterize  the.  feedback  gains  of  the 
fixed-structure  singular  LQG  controller.  For  generality  we  consider  partial  or  total  singularity  in 
both  the  control  weighting  and  measurement  noise  intensity  matrices,  and  we  allow  the  dynamic 
compensator  to  be  of  arbitrary  dimension  less  than  or  equal  to  the  number  of  plant  states  minus  the 
number  of  noise-free  measurements  or  minus  the  number  of  unweighted  ccr.trol  signals, 
whichever  maximal.  In  the  special  case  in  which  only  the  measurement  is  singular,  the  order  of  the 
dynamic  compensator  is  equal  to  the  number  of  plant  states  minus  the  number  of  noise-free 
measurements  (i.e.,  the  quasi  fuU-order  case),  and  a  certain  matrix  is  nonsingular,  then  we  show 
that  the  optimal  solution  decomposes  (seaprates)  into  a  reduced-order  observer  followed  by  state 
feedback.  Furthermore,  as  in  [19]  we  demonstrate  connections  with  earlier  results  by  showing  that 
the  fixed  structure  solution  agrees  with  the  standard  limiting  solution  when  the  latter  possesses  the 
same  number  of  differentiators  as  are  included  in  the  prespecified  controller  structure. 

As  in  [17],  the  solution  is  given  by  a  system  of  coupled  algebraic  Riccati  and  Lyapunov  equations 

A  A 

whose  solutions  (denoted  by  Q  P,  Q,  P)  are  used  to  explicitly  characterizethe  optimal  feedback 
gains.  The  coupling  is  due  to  three  oblique  projections  (i.e.,  idempotent  matrices)  which  arise  as  a 
direct  consequence  of  the  fixed  strucmre  constraint.  The  order-reduction  projection  x  defined  by 


A  AA  AA 

X  =  QP(QP)#, 


where  (  )#  denotes  group  generalized  inverse,  appeared  originally  in  [17],  while  the  static 
projections  and  V2,  given  by 

Vj  iQC^(C,Qc'',)~^C2,  v,^B,(B>,)- V,P 

are  familiar  from  least  square  analysis.  The  three  projections  are  shown  to  be  disjoint,  i.e. 

TVi  =  V2X  =  V2Vi=0.  . 


The  material  is  organized  as  follows:  In  section  2  the  case  of  singular  measurement  and 
nonsingular  performance  index  is  considered.  The  results  for  the  dual  case  of  measurement  and 
singular  performance  index  are  given  in  section  3.  The  general  solution  for  the  totally  singular 
case,  i.e.  both  singular  mearueraent  and  singular  control  weighting  matrix  is  presented  in  section  4. 
Proofs  of  theorems  are  given  in  the  appendices. 
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2.  SINGULAR  MEASUREMENT- NONSINGULAR  PERFOMANCE  INDEX. 

We  first  consider  the  case  where  the  measurement  noise  intensity  is  singular  but  the  control 
weighting  matrix  is  nonsingular,  the  system  is  g^ven  by 


x  =  Ax-h  Bu  +  w  J 

(2.1) 

yi  =:  Cjx  +  W2 

(2.2) 

y2  =  C2X 

(2.3) 

n  *  1  *  2  *  1 

X6  R”,  ue  R”^,  y^e  R  \  y^e  R  ^  andw^e  R"  ,  w^e  R  are  uncorrelated  white  noise 
processes  having  intensities  Vi>0  and  V2  >  0  respectively.  This  separation  of  the  output  noisy 
and  noise-free  components  is  not  restrictive  at  all  since  any  system  having  singular  measurement 
can  be  brought  to  this  structure  by  a  static  ouput  transformation. 

The  cost  function  is 


J  =  lim  E  ■[x^(t)R^x(t)+  u^(t)R2u(t)} 

t 


(2.4) 


where  Rj  >  0  and  R2  >  0.  The  optimization  problem  is  to  minimize  J  using  the  n^  -  th  order 
compensator. 


Xc=  AcXc+  B^y 


u  =  CcXc  +  Dcy 


(2.5) 

(2.6) 


where  y  =  [yi^  In  the  sequel  we  use  the  following  partition 


C  = 


=  BJ;  D,  =  [D 


cl 


^c2] 


(2.7) 


Note  that  as  all  modes  of  u(t)  are  weighted,  a  direct  transmission  from  the  noisy  measurement  to 
the  input  will  result  in  an  infinite  cost.  Therefore  only  the  noise-free  output  can  have  such  a  path 
and  it  follows  that  Dd  =  0. 


The  compensator  (2.5)  -  (2.6)  is  proper,  which  is  distinct  from  unconstrained  singular 
control  where  derivatives  of  the  noise-free  measurement  y2  are  often  required.  However  a  fixed 
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level  of  differentiation  can  be  accommodated  by  carrying  it  out  first  and  then  redefining  y^  and 
^2-  The  proper  compensator  acting  on  the  modified  output  is  equivalent  to  an  improper 
comepnsator  with  the  original  output  as  its  input.  From  implementation  point  of  view  this  is 
advantageous  because  the  level  of  allowed  differentiation  (which  is  often  zero)  is  also  prespecified. 

Since  J  is  independent  of  the  internal  realization  of  the  compensator  we  restrict  our  attention  to 
minimal  realizations.  Hence 


Assumption!:  (A^,  is  controllable,  (Ac,  Q)  is  observable. 


Combining  the  states  of  the  plant  and  the  compensator  we  obtain  the  augmented  system 


X 

X 


'A  +  BDcC 
BcC 


BC 

Ac 


1[^J- 


which  with  obvious  notation  is  written  as 


(2.8) 


x=  Ax+  w 


(2.9) 


To  guarantee  the  finiteness  of  I  we  make  the  following  assumption: 

Assumption  2:  A  is  a  stability matrh;  i.e.  ReX.(A)<0  Vi. 

This  includes  implicitly  the  assumption  that  there  exists  an  nc-th  order,  proper 
compensator  that  stabilizes  the  plant.  The  stability  of  A  implies  that  the  covariance  matrix  of  x 
reaches  a  steady  state  value  Q.  Patritioning  as 


lim  E{x(t)x^(t] 

t  — >  oo 


[■Qi 

1 - 

a  < 

II 

0 

II 

.^12 

j,  Q^XR 


"c 


A  -IT 

and  defining  Q  =  -  Q12Q2  ^12’  make  an  additional  assumption . 

Assumptions:  Q2>0  and  C2QC2'^>0. 


It  can  be  shown  that  a  sufficient  (but  not  necessary)  condition  for  Q2  >  0  is  that  (Aq,  Bd)  is 
controllable. 


The  following  lemma  is  required  for  theorem  2.1,  which  states  the  main  results  of  the  section. 


Lemma  2.1  [16]:  Suppose  n  x  n,  QP  are  nonnegative  definite.  Then  QP  is  nonnegtive 

A  A 

semisimple.  If,  in  addition,  rank  QP  =  nc,  then  there  exist  n^x  n,  G,  i  and  n^  x  n^ 
invertible  M  such  that 


A  A  T  T 

QP  =  G  MT;  TG  =1, 


Since  QP  is  semisimple  it  has  a  group  inverse 


=  g'^m~V 


Aaaaa# 

and  'C=QP(QP)  =G  r 


is  an  oblique  projection. 


Theorem  2.1:  Suppose  (Ag,  B^.,  Cg,  Dg)  satisfy  assumptions  1-3  and  minimize  J.  Then  they 
are  given  by 

Ac=r(A-S  P-QZ  )v,  g”^ 

°  p  ^  Q''  11 

(2.10) 

(111) 
(2.12) 

(2.13) 

Lp=BrVb’'  ;  2q  =  cX‘c, 

V,  =  diag{Vj.  CjQC^} 

C^QC^CC^QC'J  ‘ 


Bc=r[Qcy  (a-ZpP-qZq)qc^]v;' 

C„=-r;'b^Pv,^g’' 

d,=  -r;Vp[o„,,^  c;] 

where 
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Vj  =  c;c,  =  QC^(CjQC'jr'Cj 


T  A  A  A  A 

x  =  Gr  =  QP(QP)#  ; 


A  A  *  .  . 

Q  P,  Q,  P  are  n  x  n  nonnegative  definite  matnces  satisfying. 

[AVjj^h-  T^(A-LpP)vJQ+  qAv,^+  x^(A-  2pP)v,]%  Vj-  Vj^QL^V,^ 

PA  +  a"p  +  R ,  -  P  Z  T  P  I  ^Pv  ,2  =  0 

(A  -  £  P)Q+  QA  -  Z  pP)'''  +  X(A  -  ZpP)v  jQ+  Qv2(A  -  Z.pP)^''' 

+  Vij.QZ^Qv^-tj.Vjj^QZ^Qv^x^  0 

^A-QZ^)v,^+  V  J(A-QZ/P+  VTP  ZPv.j,-^Iv2p  2/v,^x^ 

A  A  AA 

rank  Q=  rank  P=  rank  QP  =  nc 

The  proof  is  given  in  appendix  A. 

It  is  seen  that  the  solution  is  given  by  a  set  of  two  algebraic  Riccati  equations  and  two  Lyapunov 
equations  coupled  by  two  oblique  projections  x  and  Vi.  The  dynamic  .projection  x  arises  as  a 
direct  consequence  of  the  fixed^structure  constraint,  and  appeared  originally  in  [17].  The  static 
projection  is  a  consequence  of  the  singularity  of  the  problem.  Similar  matrices  appear  in  least 
squares  analysis.  P,  Q,  x  and  Vj  which  are  the  solution  of  eqs.  (2.14)  -  (2.17)  are  then  used  to 
obtain  the  various  matrices  of  the  compensator,  given  by  eqs.  (2.9)  -  (2.13). 


(2.14) 

(2.15) 

(2.16) 

(2.17) 

(2.18) 


Remark  2.1:  A  relation  that  is  shown  in  the  proof  of  theorem  2.1,  and  which  is  typical  to  singular 
observation  order-reduction  problems  [15,18,19]  is  xvj  =  0; 


Remark  2.2:  the  nonsingular  reduced  order  compensator  [17]  is  recovered  by  setting  C2-O 


and  consequendy  =  0, 6^2  =  0,  =  0. 

Remark  2. 3:  The  identity  Pt  =  P  was  used  in  the  derivation  of  eq.  (2.  17)  to  get  the  compact 
expression  P(A  -  Q  The  disadvantage  of  this  form  is  that  the  matrix  that  postmultiplies 

P  is  singular.  Hence  eq.  (2 . 17)  cannot  be  solved  as  a  Lyapunov  equation.  This  can  be 
remedied  by  using  the  unsimplified  Pj^A  -  QS  ^  -  i:(A  -  QS  q)v  j  J 

Remark  2.4:  Note  that 

(2.19) 


This  is  a  degenerated  form  of  a  well  known  transformation  used  in  optimal  unconstrained  singular, 
estimation  to  generate  a  lower  order  nonsingular  estimation  problem.  The  difference  between 
(2.19)  and  those  cases  is  that  here  the  matrices  on  the  left-hand  side  are  generally  nonsquare. 

Remark  2.4  leads  to  a  discussion  on  the  recovery  of  the  quasi  full  order  case  fi’orh 
theorem  3.1.  It  is  known  from  singular  estimation  theory  (20-  23]-  ihat  if  C2V^C2>_0  then 
the  optimal  observer  does  not  possess  differentiators  and  its  order  is  n  -  r2.  From  the  separation 
principle  which  holds  in  that  case  the  optimal  LQG  compensator  has  the.same  order.  Therefore  the 
quasi  full  order  case  n^.  =  n  -  r2  is  the  singular  case  equivalent  of  the  full  order  case  n,.  =  n  in  the 
nonsingular  case. 

Now  if  n^  =  n  -  r2  then  both  matrices  on  the  left-hand  side  of  eq.  (2.19)  are  square  and 
therefore 

C^(C2QC^)-' 

(2.20) 

Or  ■ 


Substituting  this  relation  into  eqs.  (2.15)  and  (2.14)  we  get 


(2.21) 
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PA+ATp  +  Rj  -  PEpP  =  0 

AVi^QvJ  +  a\  -  V  qQv^];  +  V^v  =  0 


(2.22) 


(2.23) 


Eqs.  (2.22)  -  (2.23)  lead  to  two  immediate  conclusions.  First  that  Q  and  P  are  given  by  two 
uncoupled  equadons  (Vj  depends  solely  on  Q),  i.e.  separation'holds  in  this  case.  Secondly,  the 
control  equation  (2.22)  is  the  standard  Riccati  equation.  To  further  relate^our  result  with  optimal 
singular  LQG  we  state  the  following  lemma  which  summarizes  results  that  were  obtained  in  [19]. 

^  *r 

Lemrna  2.2:  Consider  the  system  (2.1) -(2.3)  and  assume  that  C^VjC^  >  0.  ^  is  the 

optimal  estimation  of  x  and  Pq  is  the  corresponding  error  covariance  matrix.  Then  if  nc-n-r2 


the  following  relations  hold: 

(i)  (2-24) 

(ii)  v=(v,+  py)Cj(C2V,cJ)  Cj  (2.25) 

(iii)  X  =  v,^G’'ii+Cjy2  (2.26) 

T|=r(A-Q2^v,j^G^n  +  r[QC^  {A-QEQ)QCj]v;'y  +  rBu  (2.27) 


Note  that  by  combining  the  optimal  observer  (2.26)  -  (2.27)  and  the  optimal  state 
feedback 


u=-R2  Vp^ 


(2.28) 


We  get  the  compensator  matrices  (2.10)  -  (2.13).  Hence  the  quasi  full  order  case  is  recovered 
from  rhe  results  of  theorem  2.1. 
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2.  NONSINGULAR  MEASUREMENT -SINGULAR  PERFORMCE  INDEX. 

We  consider  now  the  case  where  there  are  linear  combinations  of  the  input  which  are  not  weighted 

nil 

in  the  cost  funcaon.  The  input  is  separated  to  a  weighted  component  Ui  e  R  and  an 
unweighted  component  u^eR  .  The  plant  is  now  given  by 

x  =  Ax+ BiU  1+ B2U2‘*' '''i 

(3.1) 

y  =  Cx  +  W2  •  0.2) 

where  the  measurement  is  nonsingular,  i.e.  >  0*  The  performance  index  is 

J  =  lim  E^x^RjX  +  u^R^u  j}  Ri>0,  R2  >0.  (3.3) 

t  — ^  ^ 


We  make  the  following  assumption.. 


T 

Assumption  4;  P2>0  and  B2PB2>0  where  P2,  P  which  are  defined  in  the  proof  of 
theorem  2.1.  are  analogous  to  Q2  and  Q  respectively. 

We  have  now  the"  following  result  which  is  dual  to  theorem  2  .  L 

Theorem  3. 1:  Suppose  (A^.,  B  D^.)  satisfy  assumptions  1,  2  and  4  and  minimize  J . 
Then  they  are  given  by 


Ae=rv2^(A-QZQ-LpP)G'^ 

B.=  rv^QcV,' 

--iTb^p 

Cg  —  R-  T 

^  |_b^p(a-2;,pP-SqQ) 


Dp 


X 


n 


QC'^V 


- 1 
2 


(3.4) 

(3.5) 

(3.6) 


where 


(3.7) 


Remark  3.1;  Though  theoretically  the  problem  is  completely  analogous  to  the  singular 
measurement  case  there  is  a  difference  in  the  physical  interpretauon.  Using  a  static  gain  for  a  noise 
free  output  is  a  sound  engineering  practice,  allowing  the  variance  of  cenain  inputs  to  be  infinite 
because  they  are  not  weighted  is  not.  In  case  of  included  actuator  dynamics  this  may  be  justified 
because  u  is  only  the  command  to  the  actuator.  In  other  cases  the  results  of  this  section  should  be 
viewed  as  theoretical  bounds  on  the  expected  performance  when  near  zero  weights  are  assigned  to 
the  inputs  which  are  unweighted  here. 
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4.  THE  GENERAL  CASE  -  SINGULAR  MEASUREMENT  AND  PERFORMANCE  INDEX. 


The  general  case,  which  combines  the  two  types  of  singularity,  is  now  considered.  The 
measurement  contains  noise-free  components  and  some  components  of  the  input  are  not  weighted. 
The  system  and  the  performance  index  are  given  by 

x  =  Ax+  B^Uj+  B2U2+  w 

(4.1) 

-  yj  =  CjX+W2 

(4.2) 

X 

u 

II 

>> 

(4.3) 

J=  lim  .[x^RjX  +  uIr^Uj].  R^^O,  R2>0 

(4.4) 

t  — >  oa 


The  optimal  compensator  for  this  case  is  characterized  by  the  following  theorem. 


Theorem  4.1:  Consider  the  system  (4.1) -(4.3)  and  the  cost  (4.4).  Suppose  (A^,  Bg,  C^,  Dg) 
satisfy  assumptions  1-4  and  minimize  J.  then  they  are  given  by 


B,=  rvjQc|  (aq  +  qa’'+v,)]v 


--1 

z 


Co  = 


-R;‘[b>  B^2(fA+A'^P+R,)]v,^G'' 


D.  =  . 


_-l|  ®m,xr 

R 


1  1 


LB‘PQc; 


b;pqc‘ 

B2P(AQ+  Qa”^  +  V^)C2 


V-' 


(4.5) 

(4.6) 

(4.7) 

(4.8) 


where 


2q  =  cIv-'Ci 


2,  =  B,R-,‘b^ 


A  =  A-Q£q-2pP  q  =  C^(CjQdj)  ‘  Bj  =  (b^PB2)  B 


T 

Z 


and  Vj,  v^,  G\  r,  T,  and  R^  are  as  defined  before.  Q  P,  Q  and  P  are  nonnegative 
matrices  satisfying 
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[ A''lx  -  z  pF)v  J  Q+  Q[ -  S J,P) V ,]’■  +  v,j^V,v]j^ 

+  ^i'’2x'^i'’L''I-''x''2j.'’i±^i'’L.''L''I-Q(a’"C2Cj+  C^CjA+  vy^SgV  Jq+ 
''x'’2x‘2(a’'C2'=2+  +  V^^SqV  jQv^^t];  =  0 


V^(A-  ZpP)Q+  -ZpPfv^^+  Vj^v,^QIqQv]-,  v^- 

V2x''ix‘JSQ'’L.'’Ii''1+  -tv  J(A-ZpP)Q+  Qa’'+  V  JvJ 
+  v£(A-ZpP)Q+  QA'^+Vjfv^t'f  =  0 


(4.10) 


P[V2xA  +  '’2(A  -  Q2;q)  v,^t  J  [V  J^A  +  Vj(  A  -  QZq)V  J^P  H-  jV  j, 

+  ,Vjt  J_  -  x^v^j^v  ,v  p(ab  +  B  jB  jA"^  +  v^Z  pV^)p  4- 

X^V^xK*®!®!  ®2®2A^+  '’2X®p'’L.)'^IX-'x=® 


„T  „T 


(4.11) 


P(A  -  QZq)v  4-  V \^(iA  -  QZq)  P  -r  VjV^PZ  pPv^,  - 


x‘v;j(A-  Zq(2)P+  PA  +  Rjlv^ 
vT[(a  -  Zq(3)P  +  pa  +  R^fx  =  0 


(4.12) 


Proof:  The  proof  is  given  in  Appendix  B. 
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Remark  4.1:  the  three  projections  are  disjoint  as  can  be  seen  from  the  following  relations  which 
are  derived  in  the  proof  of  theorem  4.1 

xvi=0  ;  V2t  =  0  ;  V2Vi=  0  (4.13a,b,c) 

As  a  result,  some  combinations  of  the  projection  matrices,  such  as  XV2J_  and  v^juX  n'e  also 
projections.  The  results  of  theorem  4.1  may  be  interpreted  using  those  combined  project  is.  For 
example,  rv2  and  which  premultiply  and  postmultiply  respectively  the  bracketed  term  in  the 
expression  for  in  eq.  (4.5)  are  the  factorization  of  the  projection  tv2jl.  Eq.  (4.13)  gives  also 
an  order  bound  for  the  compensator.  Eqs.  (4.1 3a, b)  state  that 

nc<  n  - max(r2, 1112)  (4.14) 

(4.13c)  means  that  the  sum  of  the  singular  variables,  i.e.  r2  +  m2  should  not  exceed  n. 

Remark  4.2:  To  reco\er  the  results  of  sections  2  and  3,  i.e.  the  one-side  singular  problems,  the 
relations 


r(QA'^4- Vj)C2  =  0 

(4.15) 

32(a’^P  +  RPG'^  =  0 

(4.16) 

which  are  proved  in  Appendix  B  should  be  used.  In  case  either  Vi=0  or  V2  =  0,  eqs.  (4.15)- 
(4.16)  imply  that  all  terms  involving  QA^*  +  Vj  and  A*^P  +  Ri  vanish  and  the  results  of 
theorems  2.1  and  3.1  are  recovered. 

Remark  4.3:  The  expressions  for  the  compensator  matrices  are  not  unique,  which  is  in  contrast  to 
the  results  in  the  nonsingular  and  one-side  singular  cases.  The  matrices  that  correspond  to  the 
signals  U2  and  y2  have  alternative  expressions. 


Ac=r( 

v,A+B,B,(A-P  +  R,)]v,^g'^ 

(4.17) 

B..  =  I 

jk. 

t'',A-B,B,(A'"p+R,)]c-, 

(4.18) 

Cc2  =  - 

-B-[av,^-(Qa'^  +  V,)CjCj]g'' 

(4.19) 

^c22  “ 

-[b*A+  B(a'^P  +  Rj)]c* 

(4.20) 

This  is  a  consequence  of  the  relation  in  eqs.  (B.  27) 
B "^(Qa”^  -f-  V j)C 2  =  B 2(T,  -t-  A^P) QC2 
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AppendixA:  Proof  of  Theorem  2.1 

From  eq.  (2.9)  and  by  assumption  2  it  follows  that 

AQ+QA^+V  =  0 

where 

0 

V=  T 

0  V,b‘ 

L  1  iJ 

Defining 

^2^C2^2^C2^2  ^2^C2^2^C 

R  = 

.^C^2^C2^2  ^C^2^C 

The  cost  J  may  be  written  as  J  =  tr<^ 

Adding  the  constraint  (A.l)  we  define  the  Lagrangian 

T 

H  =  tr[QR+ (aQ+ Qa  +  V)P]. 

3H  /  8P  =  0  leads  to  (A .  1) ,  the  other  partial  derivative  yield 

8H/aQ=  Pa+  A^P  +  R  =  0 

aH/aAc  =  Q2P2+Ql2Pi2  =  0 

3H/3B<.^  =  C,QiP,j+C,Q,jPj+vXp2  =  0 

3H/3B(,  =C,Q,P,2  +  CjQ,jP2=0 
2 

an  /aCc  =  o 


(A.1) 


(A.2) 

(A.3) 

(A.4) 

(A.5) 

(A.6) 

(A.7) 
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aH/3D<,  =  C  jQ,P  ,B  +  +  C  =  0 


Subblocks  of  (A.l)  and  (A.3)  give 

AdQi  +  Q  QuC>''  +  V ,  =  0 

AjQj2  +  BC(,Q2+ QjC  B^,  +  Q^2A(;  =  0 

B  cCQ,2  +  A<,Q2  +  Q2.4  +  q'JjC’'b'J,  +  B  c  VjB^^  =  0 

BlAd+  A>,  +  P,2BcC+  C^B^^P^jt  R,  +  C>^R2D(,C2=  0 


BiBCc  +  Pi2Ac+  A,P,2  +  cXp2+  C»2C^=0 


B^BCc  +  C>'"Pi2  +  PjA^  +  A>2+  C^RjC^  =  0 


where  A^=A+BD^,2C2 


Writing  (A.14)as 


P2(Ac+  P2PnBCc)+(Ac  +  P2P,2BCerP2+  C^R2Cc  =  0 


(A.8) 


(A.9) 


(A.  10) 


(A.n) 


(A.12) 


(A.  13) 


(A.14) 


(A.15) 


where  P2'*‘  is  the  Moore-Penrose  generalized  inverse  of  P2,  it  follows  from  the  observability  of 
(Cc.  Ac)  that  P2  is  positive  definite,  hence  invertible,  see  [17]. 

Define  now 


0‘=Q,2Q2‘;r'=-P'2‘pl2;  ’:  =  G‘r  ;  Q=Q.2QV'3'i2  ;  P=Pi2P'2‘b‘i2 


-UT 


.-UT 


Q=Q,-Q  ;  P  =  P,-P 
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Abstract 

This  paper  considers  the  problem  of  fixed-order  dynamic  controller  synthesis  with  both  Hj  and 
Hoo  performance  criteria.  Sufficient  conditions  characterizing  the  optimal  compensator  for  both 
singular  control  weighting  and  singular  measurement  noise  are  given.  The  solution  consists  of  a 
set  of  two  algebraic  Riccati  equations  and  two  algebraic  Lyapunov  equations  coupled  by  three 
projection  matrices.  One  is  the  standard  order  reduction  projection,  while  the  other  two  reflect  the 
two  types  of  singularity  present  in  the  system.  The  three  projections  are  shown  to  satisfy  disjointness 
conditions.  In  addition  to  order  reduction,  an  advantage  of  the  fixed-structure  approach  is  that 
differentiation,  which  is  often  undesirable  from  a  practical  point  of  view  and  which  arises  due  to  the 
singularities,  can  be  avoided.  The  fixed-order  compensator  agrees  with  the  unconstrained  solution 
when  the  latter  possesses  the  same  number  of  differentiations  as  axe  included  in  the  prespecified 
controller  structure  and  when  the  order  is  selected  appropriately. 
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Appendix  B:  Proof  of  theorem  4.1 


Following  the  development  in  Appendix  A  we  get  the  Lagrangian  (A.2)  with 


V  = 


Bc,V,D^„B^ 


®  2^021^2®  Cl 


BC1V2BCI 


&  = 


Rl  + 


^C1^2^C12^2 


p  n 


p  r* 

^C1^2^C 


1 


Now 

3H/aAc  =  Q'J,P,,+  Q,P,=.0  (B.1) 

3H/3B^,=  C,QjP,,+  C,Q,,P,+  V,bV,=  0  (B.2) 

3H/3Bcj=CjQiP,j+CjQ,jPj  =  0  (B.3) 

3H/3C(,J=  Q>jB^+  Q2P>2+  Q2C'^,Rj+  QI2CXuR2  =  0  (B.4) 

3H/3C<.j  =  Q>iBj+QjP>j  =  0  (B5) 


3H/3Dc,j  =  CjQ,PiB,+  CjQ,jP>  ,+  CjQ,jC>j+  CjQ,cX,2Ri  =  0  (B.6) 

3H/3D„,  =C,Q,P  ,B,  +  CjQi,P>,  + V,d’'^,,B>,B,  + V,b"„p|,B,=  0  (E7) 

3H/3D,^=C,Q,P,B,  +  C3Q,jP>,=  0  (B.8) 

T 

aH/ap  =  AQ+QA  +v=o 
aH/at^=?A+ A^p  +  p=o 


Submatrices  of  these  equations  give 
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(A+  BD.OQj  +  Qj(A+  BDcG)'^+  BCcQ]^+Q^^c]/  +  Vj+  2^ai®2=  ^  ^^-9) 

(A+  BDcC)Qj2+BCcQ2+  QiC'^Bc  +  Qi2Ac  +  B2Dc2jV2Bci  =  0 

AcQ2+  B^CQj^  +q]2C"bVBciV2b''c,  =0  (B.11) 

Pj(A+  BDcC)+  (A+  BD^O^Pj  +  Pj^BcC  +  C^bX  +^1+  ^>012^2^012^2  =  0  ^^.12) 

* 

P,BCc  +  P,jA<,+  (A+BD^C)’’p„+c'^B>j+cX„RjC(.,=  0  (B.13) 

PjAc  +  A^Pj+  P;BCj,  +  CyP,j+  C^^,R,C^  ,=0  (B.  14) 


Eq.  (B.  1)  gives  the  projection  i:  =  G^r.  From  (B.3)B~\  using  = 

obtain  EQC^O,  or  ia'j  =  0.  Similarly  Q~^(B.  5)  leads  to  B>G^=0  or  \^x  =  0. 

7  A  A  X 

Using  these  results  together  with  Qi2Bi2“QB  we  get  out  of  eq.  (B.  8),  C2QPB2  =  0 

or  vp  1=0.  So  the  partial  derivatives  with  respect  to  the "  singular"  coefficients  lead  to  ±e 

....  ^ 
disjoinmess  condinons.  (B.  2)1^2+ (B.  7),  noting  that  QPB2  =  0,  gives 

d„,=-b;qc>-‘ 

T 

The  dual  (B .  6)  -  C  2G  (B.  4 )  leads  to  the  dual  expression 
^C12  =  “^2  ®1^2 

Substituting  D^j  and  D^j2  (B.  2)  and  (B.  4)  respectively  we  have 

Bci  =  rv2,QC>;’‘  (B.17) 

Ccj  =  -R2’ByPVj^G^  (B.  18) 


(B.  15) 


(B.  16) 
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(B.9)  -  (B.10)  -  g'^(RIO)'^  +  g'^(B.11)G  gives 

(A+  BDj,C)Q+  Q(A+  BP^,C)'^-g'^BcCQ-  Qc'^b'^G  +  ^  2^  cii^ 

-  B2Dc2i''2Bc.G  -  +  G^B^,V,b'5.,G  =  0 

(B.19) 

r(B.15)C2+  p2\B.13)QC2,  using  rQC2  =  0,  yields 

r[Q(A+  bd<.c-g'^b^c)  +  v,  +  b,Dcj,v,(d'^„,b'^,-b^^;G)]c^ 

-  B  c.''2(Dc2,B2  -  B  ciG^)  cl  +  p-  'c^b’^PQC^  +  P-,  'c^„R,D„,C  .QC^  =  0 

(B.20) 

Substituting  D^j2'^^2i>  ®ci’ ^ci  “sing  rQC2=0,  B2PQC2  =  0,  we  obtain 

r(QA'^  +  Vj)C2=0  (B.21) 

Similar  operations  on  eqs.  (B.12)  -  (B.14)  and  (B.IO)  give  the  dual  relation 

B2(a’^P+Rj)g’^  =  0  (R22) 

Substituting  Dc2i.  Bd  and  Cd  into  (B.19)  and  rearranging  we  have 

(a  -  ZpPv  J  +  B2D^22^  2“  G  B  ^^2)  Q(^  “  ®  2^C22^  2”  ^  ^02^2) 

■*-Vi-Q2qQ  +  "i''2iQ^qQ''21^I  =  0 

(B.23) 

B2P(B.23)C2  gives,  using  B2PG'^  =  0,  B2PQC2  =  0 

B>(A-2pPVj+B,D^jjC,)QC^  +  B^p(qA^+V,)cJ-B^PQZqC^  =  0  (B.24) 

Premultiplying  by  (B2PB2)~^  and  postraultiplying  by  (C2QC2)""^  we  get 

Dc22=-b;(a-IpP-qZq)c;-b;(qa^v,)c,  (B.  25) 
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Constructing  the  dud  of  (B.  18),  similar  operations  lead  to 


Dc22  =  -  BU  A  -  2  pP  -  QS  q)c;-  B  a'^P  +  R,)c;  26) 

Therefore 

b'5p(Qa'^+VPC2=B2(a'^P+ R^QC^  (R27) 

This  realtion  is  the  source  of  the  alternative  expressions  in  remark  4.3. 
r(B.  18)  C  2  gives,  after  substitution  of  D^22 

B„=r(A-2pP-Q2;Q)C-,+  rB,D^  =  IV^('A-ZpP-Q£Q)q-rv,(A’'p+R^C, 

(B.28) 

(B.21)  implies  that  -rv2  may  be  replaced  by  rv2j_,  hence  (4.6).  The  expression  for  Cc2  is 
obtaiend  by  operating  in  a  similar  fashion  on  the  dual  of  (B.23). 

Substituting  D(^2  ^ca  it^^o  (B.23)  we  have 

[A-ZpPv,-t^Vj{A-BpP-Q2Q)v,-Tjy2(QA'^  +  Vj)CjCj-t(A-ZpP-Q2(j)v,]Q 

+  q[a- ZpPVi-t^VjlA-BpP- Q2^v,-tj^V2{QA^+ V,)C,Cj-t(A- 2pP-Q2Q  )v,]’' 

+  V,-Q2,Q+Tj,v^QS,Qv^jtJ  =  0  (B.29) 

X 

(B.  29)-G^(B.  21)C2  —  C2(B.21)*G  gives,  using  tj^V2+ 1  =  1- 
[  AVj^+  2j^(A  -  S  pP)]  Q+  q  AV,2^  +  T2,V2j.(  A  -  2  pP)]'^  +  (I  -  <jV , 

-  a'^CjC  2)Q  -  (I  -  ^2^) v,v  J+  Q(v|X  A)Q(I-  v J j}) 

+  Yi-Q2^,Q+T2^V2^Q2jjQvJj^t];  =  0  (B.30) 

The  following  relations  are  used  to  get  (4.9)  from  (B.30): 
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I  — T  V  =  V  • 
±21  1± 


,V, , 

±  21  11 


(B.  9)  -  (B,  19 )  gives,  using  =  FQ 


(A+  BD^.C)Q+  Q(A+  BDcCr+  GCcrQ  +  ^r‘^C^B+  g’^B(,CQ+  pc’^B^G 
-  B^D  cnVjB'^^G  -  g'^B  c,V +  g’^B  c,V ^b'^^G  =  0  (B.  31) 


Substitution  of  Cj,  andB^,,  using  i:Q=Q  leads  to  (4.10).  Eqs.  (4.11)  and 
(4.  12)  are  dual  to  (4.  9)  -  (4. 10)  and  are  achieved  by  the  same  procedure.  Finally  to 
find  A  we  take  [(B.  11)- rv2j^(B.  10)]  Q~  ^  and  have 


Ac= -b<,cg''+  rv^^QC>^,  -  BciV^b'^,,  +  rVjJA+  BD^C)Q„+  rv^BC^Qj 


(B.32) 


Substimting  Be,  Cc,  Dc  into  (B.32)  we  get  (4.5). 
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Abstract 

This  paper  considers  the  problem  of  fixed-order  dynamic  controller  synthesis  with  both  Hj  and 
Hoo  performance  criteria.  Sufficient  conditions  characterizing  the  optimal  compensator  for  both 
singular  control  weighting  and  singular  measurement  noise  are  given.  The  solution  consists  of  a 
set  of  two  algebraic  Riccati  equations  and  two  algebraic  Lyapunov  equations  coupled  by  three 
projection  matrices.  One  is  the  standard  order  reduction  projection,  while  the  other  two  reflect  the 
two  types  of  singularity  present  in  the  system.  The  three  projections  are  shown  to  satisfy  disjointness 
conditions.  In  addition  to  order  reduction,  an  advantage  of  the  fixed-structure  approach  is  that 
differentiation,  which  is  often  undesirable  from  a  practical  point  of  view  and  which  arises  due  to  the 
singularities,  can  be  avoided.  The  fixed-order  compensator  agrees  with  the  unconstrained  solution 
when  the  latter  possesses  the  saune  number  of  differentiations  as  are  included  in  the  prespecified 
controller  structure  and  when  the  order  is  selected  appropriately. 
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1.  Introduction 


The  Riccati  equation  approach  to  Hoo  controller  synthesis  is  now  well  established  [1-7].  The 
purpose  of  the  present  paper  is  to  go  beyond  earlier  work  by  addressing  the  problems  of  singular 
measurement  noise  and  singula  control  weighting.  The  approach  we  take  is  based  upon  fixed- 
structure  controller  synthesis  with  both  Hj  and  Hoo  performance  criteria  as  in  [5,7].  It  is  well 
known  that  singularitieL  in  the  problem  formulation  may  lead  to  improper  compensators,  that  is, 
compensators  with  differentiators  [8].  The  fixed-structure  approach,  however,  aJlows  us  to  specify 
the  compensator  structure  a  priori,  thus  eliminating  differentiation  of  measurement  signals  if  so 
desired.  If  differentiation  is  desired,  then  the  differentiated  signak  can  be  included  as  additional 
measurement  signals  and  then  treated  within  the  fixed  structure  approach  £is  “original”  signals. 

The  treatment  of  singular  problems  in  the  present  paper  is  a  direct  extension  of  results  obtained 
for  singular  H2  problems  in  [9-13].  The  reader  is  referred  to  these  papers  for  discussions  of  singular 
control  issues  as  well  as  extensive  references  to  the  singuleur  control  and  estimation  literature. 


Notation 

Note:  All  matrices  have  real  entries. 

IR,IR’‘^',IE  real  numbers,  rxs  real  matrices,  expected  value 

Ini  )^j0rx«>0r  f  X  »■  identity  matrix,  transpose  rxs  zero  matrix,  0,.xr 

tr  .  trace 

IN’',P''  r  X  r  nonnegative-definite,  positive-definite  matrices 

n,Tn,£,£i,&2,Tic,d,doo,q,qoo]n  positive  integers;  n  +  nc(nc  <  n) 
x,u,yi,i/2,Xc,x  n, m,£i,£2,nc,n-dimensional  vectors 


y,® 

A,B,Ci,C2 

C 

Ac,  Bel,  Be2,Cc,  Dell,Dci2 
Be,  Be 

A 

«;(•) 

Di,D2 

Dico,D2  00 


nx  n,nx  m,£i  X  n,£2  x  n  matrices 

[Cl  C2] 

Tie  X  Tie, Tic  X  £i,nc  x  £2,m  x  ne,m  X  £i,m  X  £2  matrices 
[Bel  Be2],  [Hell  Hc12] 

A  +  BDcO  BCg 

BeC  Ae 

d-dimensional  standard  white  noise 
nx  djtiX  d  matrices;  DiDj  =  0 
nx  de^,£x  dea  matrices;  DicoDjoo  =  0 


1 


^looj^oo 

b 

V 


Bi,E2 

E 

RuRi 


R 

BlOO)  E200 

Raa 


E,2 

A  7 


D^D'l^DiDh  V2GIP^‘ 

DiooDL.  D2coDJ^ 

BciDj 

0nxn« 

0„.xn 

q  X  n,q  X  m  matrices;  B1E2  =  0 

[Ei  +  Eib^C  EiCc] 

E^Ei,  B^Er,  R2  €  P"" 

Ri  +  C'^DjRiDcC  C^DjUjC/ 
CjRiDcC  CJR2CC 

5oo  X  n,  goo  X  m  matrices;  BJ^B2oo  =  0 

’Bioo  + C^BjiJjcoBoC  C^Dji?2ooCo 
CjRi^D^C  Cj^RiooCc 

nonnegative  constant,  positive  constant 


2.  Problem  Statement 


In  this  section  we  consider  the  Hj  dynamic-compensation  control  problem  with  constrained 
Hoo  disturbance  attenuation  for  the  case  in  which  the  measurement  noise  intensity  is  singular  but 
the  control  weighting  matrix  is  nonsingular.  Given  the  nth  order  stabilizable  and  detectable  plant 
(see  Fig.  1) 


x{t)  =  Az{t)  Bu(t)  -}-  (2.1) 

1/1  (t)  =  C7iz(t)  +  D2Vj{t),  (2.2a) 

y2(t)  =  C'3i(«),  (2.26) 

determine  an  noth  order  dynamic  compensator 

Xc(0  =  AcXc{t)  -r  Bey(t),  (2.3) 

u(t)  =  CcXc(t)  +  Dcy{t),  (2.4) 

■4 

that  satisfies  the  following  design  criteria; 
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i)  the  closed  loop  system  (2.1)-(2.4)  is  asymptotically  stable,  i.e.,  A  is  asymptotically  stable, 
it)  the  goo  X  p  closed-loop  transfer  function 

G{s)^E^Li^-A)-^D  (2.5) 

from  w{t)  to  Zoo{t)  =  Eioox{t)  +  £72oo«(0  satisfies  the  constraint 

II^WIloo  ^  "Yj  (2-6) 


where  7  >  0  is  a  given  constcint;  and 
Hi )  the  performance  functional 

J(Ac,  B,,Cc,  Dc)  =  ^Hm  +  u'^(t)iJ2u(i)]di}-  (2.7) 

is  minimized. 


The  closed-loop  system  (2.l)-(2.4)  can  be  written  as 


x{t)  =  Ax(t)  +  3w{t), 


v/hile  (2.7)  becomes 

J{Ac,Bc,CcyDc)  =  ^lirm  IE{(|x(t))'r(i5(t))}. 


(2.8) 


(2.9) 


Since  all  of  the  components  of  u{t)  are  weighted,  a  direct  transmission  term  from  noisy  mea¬ 
surements  to  weighted  inputs  will  result  in  an  infinite  H2  cost.  Therefore,  we  set  Dd  =  0.  Note  also 
that  the  problem  statement  involves  both  H2  and  H^o  performance  weights.  For  convenience  we  de¬ 
fine  Ri  =  El  El  and  R2  =  EjEi.  Although  an  cross  weighting  term  of  the  form  2x'^{t)Ri2u{t) 
can  be  included,  we  shall  not  do  so  here  to  facilitate  the  presentation. 

For  the  Hoo  performance  constraint,  the  transfer  function  (2.5)~invol/es  weighting  matrices  Exoo 
and  E200  for  the  state  and  control  variables.  The  m^trice..  Ri^o  =  Ei^Eioo  and  R200  =  E2ooE2<x> 
are  thus  the  Hoo  counterparts  of  the  H2  weights  Ri  and  Rj.  Although. we  do  not  require  that  Rioo 
and  R200  be  equal  to  Ri  and  R2  we  shall  require  that  Rzoo  where  the  nonnegative  scalair 

is  a  design  variable.  Finally,  the  condition  E'^^E2<x>  =  0  preclv.des  an  Hoo  cross- weighting  term 
which  again  facilitates  the  presentation.  Similar  remarks  apply  to  the  disturbance  and  sensor  noise 
intensities  Vj  =  D?,  V2  =  Z?2i?2T,  Vioo  =  and  V200  =  D2<^D'^^  for  the  Hj  and  Hoo 
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designs  respectively.  Finally  for  convenience,  we  assume  DiD^  =  0  which  effectively  implies  that 
the  pleint  disturbance  and  sensor  noise  are-uncorrelated. 

If  A  is  asymptotically  stable  for  a  given  compensator  {Ae,Bc,  Cc,  Dc),  then  the  performance 
(2.9)  is  given  by 

J(^Aef  BcyCcf  Dc)  —  tr  QR, 

where  the  steady-state  closed-loop  covariance  defined  by 


Q  =  ^lim  IE{5*^(t)x(t)} 

(2.10) 

satisfies  the  n  x  n  algebraic  Lyapunov  equation 

0  =  AQ  +  QA^  +  V. 

(2.11) 

The  key  step  in  enforcing  the  disturbance  attenuation  constraint  (2.6)  is  to  replace  the  alge¬ 
braic  Lyapunov  equation  (2.11)  by  an  algebraic  Riccati  equation  which  overbounds  the  closed-loop 
steady-state  covariance.  Justification  for  this  technique  is  provided  by  the  following  result. 

Lemma  2.1.  Let  (AcBctCaDc)  be  given  and  assume  there  exists 
definite  matrix  Q  satisfying 

an  rt  X  n  nonnegative- 

0=^AQ  +  QA'^  +  'j-'^QR^Q  +  V. 

(2.12) 

Then 

(A,  b)  is  stabilizable 

(2.13) 

if  and  only  if 

A  is  asymptotically  stable. 

(2.14) 

In  this  case, 

llC?(s)(|oo  <  7 

(2.15) 

and 

<3  <  2. 

(2.16) 

Consequently, 

JiAc,Bc,C„D,)  <  J{A,,B,,C,,D„0), 

(2.17) 

where 

\ 

.;(Ac,Sc,Cc,I?c,<2)  =  tr  <2R. 

(2.18) 
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Proof.  See  [5].  □ 


3.  The  Auxiliary  Minimization  Problem 

As  shown  in  the  previous  section,  replacing  (2.11)  by  (2.12)  enforces  the  Hoo  disturbeince 
attenuation  constraint  and  yields  an  upper  bound  for  the  H2  performance  criterion.  That  is,  given 
a  compensator  {Ac,Bc,Cc,Dc)  for  which  there  exists  a  nonnegative-definite  solution  to  (2.12),  the 
acfua/Hj  performance  J{Ac,Bc,Cc,Dc)  of  the  compensator  is  guaranteed  to  be  no  worse  than  the 
bound  given  by  J{Ac,  Bc,Cc,Dc,  Q)-  Hence  J{Ac,Bc,Cc,  Q)  can  be  interpreted  as  an  auxiliary 
cost  which  leads  to  the  following  optimization  problem. 

Auxiliary  Minimization  Problem.  Determine  {Ac,Bc,Cc,Dc,Q)  that  minimizes  J{Ac, 
Bc,Cc,Dc,Q)  subject  to  (2.12). 

It  foUov/3  from  Lemma  2.1  that  the  satisfaction  of  (2.12)  along  with  the  generic  condition  (2.13) 
leads  to  :  (1)  closed-loop  stability;  (2)  prespecified  Hoo  disturbance  attenuation;  and  (3)  an  upper 
bound  for  the  Hj  performance  criterion.  Hence,  it  remains  to  determine  (Ac,Be,Cc,De,Q)  that 
minimizes  J{Ac,  Be,Ce,De,  Q.),  and  thus  provides  an  optimal  bound  for  the  actual  Hg  performance 
J(Ao,Bo,Co,Do). 


4.  Sufificient  Conditions  for  Hoo  Disturbance  Attenuation  with  Singular  Measurement 
Noise 

In  this  sec' ion  we  state  suflScient  conditions  for  characterizing  fixed-order,  (i.e.,  full-  and 
reduced-order)  ."ntrollers  guaranteeing  closed-loop  stability,  constrained  Hoo  disturbance  atten¬ 
uation,  and  an  optimized  Hj  performance  bound.  For  arbitrary  matriojs  Q,P,Q  e  define 

the  notation 

=  QC^iCiQC?  +  l-^C^QPSiQCjy^Ciilr,  +  r^QPSi),  r^iooX  =  /n  -  ^^loo, 

S  =  BRi^B'^,  S  =  C^Vf^Ci, 

C2  =  QCJ{C2QC^  +  'i-^C2QPSiQCj)-\ 

when  the  indicated  inverses  exist. 
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Allowing  the  "compensator  to  be  of  fixed  dimension  tia  which  may  be  less  than  the  plant  order 
n,  leads  to  an  oblique  projection  that  introduces  additional  coupling  in  the  design  equations.  The 
following  lemma  is  required. 

A  A  A  A 

Lemma  4.1.  Let  (2)P  €  IN  and  suppose  rank  QP  =  Uc.  Then  there  exist  ric  x  n  G,r  and 
ric  X  tie  invertible  M,  unique  except  for  a  change  of  basis  in  IR”" ,  such  that 


Qp  =  a'^Mr, 

ra-^  = 

Furthermore,  the  nx  n  matrices 

r^G'^r, 

rx  =  In-T, 

are  idempotent  and  have  rank  Uc  and  n  —  ric  respectively. 

Proof.  See  [14].  □ 

Theorem  4.1.  Suppose  there  exist  matrices  Q,P,Q,P^  IN”  satisfying 


(4.1) 

(4.2) 


(4.3) 

(4.4) 


0  =  [Ai/ix  +  rx  (A  -  SPSiCtCi  +  7"*<5i?ico)*'i]g 

+  QlAi/ij,  +  tx{A  —  IIPS1C2C2  +  i~^QRioo)^i]^  +  ^1 

-  'i~^i'iQRiooQi'T  +  I'lxQRiooQi'ix 

+  'f-^0^i^iQ(C2C2fS^PI!PSiid2C2)Qu^ 

-  vixQSQvfx  +  rx^ixQSQu'^x'^l,  (4.5) 

0  =  [A  +  7-*(g  +  g)i2ioo]'^P  +  P[A  +  7-*(Q  +  Q)i?icol 

+  J?!  —  (t'looX  +  ^2^7)'^S^PSPSi{l/ioo±  +  C2C2) 

+  rlvle^xS'^PSPSxVi^xrx.  (4.6) 

0  =  {A  -  2PSi{vie^x  +  C2C2)  +  7"*Qli2ico  +  ^\C2C2)'^S'^PSPSr{C2C2)\)Q 
+  Q{A  -  i;FS(vioo±  +  C2C2)  +  7"*Q(FiooiS'(C2C2)'^S?‘PrP5i(C2C2)]}^ 

+  r(A  —  2PS1C2C2  +  'l~^QRioo)Q^J 
+  i^iQ{A  -  SPS1C2C2  +  'f-^QRi^rr'^ 

+  l~^Q[Rloo  +  +  C2C2)'^Si  PSPSi{l/iooX  +  ^2^2)]^? 


6 


+  VixQSQv'^^i^  -  TxUixQ2Qvixr±,  (4.7) 

0  =  [(A  -  +  'i-^QRico)vix  -  'i-'^^^QiCiCifS^PSPSiiCiCifP 

+  P[{A  -Q2  +  'y-^QRico^ix  -  -f-‘^^^Q{C2C2fS^PSPSi{C2C2)] 

+  t'loo±S^P^P^l^lco±  -  PEPSiUiooXTx,  (4.8) 

-and  let  [Ac,  Be, Cc,  Da  Q)  be  given  by 

Ac  =  r[[A  -QH  +  'f-^QRico)uix  -  BPSrUiooXp'^,  (4.9) 

Be  =  r[QC'lV^^[A  -  SPSiC2C2  -Qi!  +  ^-^QRioo)QCj (CjQC?)-^],  (4.10) 

Ce  =  -R^^B'^PSiVi^xG'^,  (4.11) 

Dc  =  [0m>a,  -  R2^B'^PSp2],  (4.12) 


Q  +  Q 

rq 


qr'^ 

rqr'^ 


(4.13) 


Then  [A,D)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  c^e,  the  closed- 
loop  transfer  function  G[s)  satisfies  the  Hoo  disturbance  attenuation  constraint  (2.15)  and  the  H2 
performance  criterion  (2.7)  satisfies  the  bound 

J[Ac,  Bc,Cc,Pc)  <  tr[(g  +  q)Ri  +  q[C2C2)'^S'^PBPSi[C2C2) 

(4.14) 

+  Q(*'iooJ.  +  C2C:^'^-  PSPSi[v\co±  +  C2C^\. 


Proof.  The  proof  follows  as  in  [5]  with  the  additional  terms  arising  due  to  the  singular  structure 
of  the  probleih.  For  further  details  see  [12].  □ 

Remark  4.1,  By  setting  ric  =  n,  it  follows  that  r  —  G  —  P  =  !„  and  rj.  =  0.  In  this  case,  the 
last  term  in  each  of  (4,5)-(4.8)  can  be  deleted  yielding  the  full-order  H2/H00  singular  measurement 
noise  control  problem.  Alternatively,  by  retedning  the  reduced-order  constraint  and  letting  7  — »  00 
we  recover  Theorem  2.1  of  [l2j. 

Remark  4.2,  The  nonsingular  reduced  order  compensator  [14]  is  recovered  by  setting  C2  =  0 
and,  consequently,  i/i  =  0,  Bc2  =  0,  De  =  0. 
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5.  Sufficient  Conditions  for  Hoo  Disturbance  Attenuation  with  Singular  Control 
Weighting 

In  this  section  we  consider  the  dual  problem  involving  unweighted  controls.  The  input  is 
separated  into  a  weighted  component  ui  E  3uid  an  unweighted  component  uj  €  IR”‘“.  The 
plant  now  is  given  by  (see  Fig.  2) 


x{t)  =  Ax(t)  +  jBiUi(t)  +  B2U2{t)  +  Ditu(t),  (5.1) 

y(t)  =  Cx{t)  +  D2w{t),  (5.2) 


with  the  compensator  structure  as  in  (2.3)-(2.4),  where 


B  =  [Bi  Bj], 


D 

Dell 

Cc2_ 

)  Uc  ~~ 

Dc21  . 

We  thus  seek  to  minimize 


(5.3) 


J{Ac,Bt,Cc,Dc)  =  Urn  [  [x'^(t)Bia:(t)  +  uJ‘B2Ui(t)]dt},  (5.4) 

t-»co  t  Jq 


while  constraining 


where 


||G(5)11oo  <  7, 


Gis)^E{sh-A)-^D^, 


(5.5) 


(5.6) 


and 


■Dioo  +  B2Dc2\D2oo 
BcD2oo 


For  the  statement  of  the  next  result  we  need  the  following  definitions.  For  arbitrary  matrices 
Q,P,P  E  define  the  notation 


S2  =  iIn+^^'i-^QP)-\ 

U2  =  B2{BjPB2y^BjP,  U2±  =  In-U2, 
l'2oo  =  {In  +  S2QP)B2{B^PB2  +  PSiQPBz)-^ BJ P,  U2CCX  =  In  - 
S  =  BiR^^Bl,  S  = 

Bj  =  (BJ.PB2)-'B?P, 

\ 

when  the  indicated  inverses  exist. 
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Theorem  5.1.  Suppose  there  exist  matrices  Q,P,Q,P  &  IN”  satisfying 

0  =  [A  +  7-^(P  +  P)Vioo]g  +  Q[A  +  7-"(P  +  P)Vioo]  +  Vi 
~  {^2oo±  +  B2B2)S2QilQS2  {yzoos.  +  B2B2)^ 

+  rj.i'2oo±S2QSQS^v'^^j_Tl,  (5.7) 

0  =  [t'2xA  +  1'2(,A  —  B2B2S2QS  +  7~**^looP)j’J.]'^P 

+  P[u2xA  +  1/2(A  -  B2B2S2QS  +  7"*VkooP)rjL]  +  Pi 
-  7"**'JPViooPy2  +  I'Jj.PVlooPi^SX 
+  l~^fi^i^2PB2B2S2Q2QS^B'iBjPi^^ 

-  V2xP^P^2X  +  T-Jt'JxP-SPt'ajL^x,  (5.8) 

0  =  h±(A  -SP  +  7“ ViooP)  -  7“V^P2P252Q5QSf  SjBjPjQ 
+  <9hx(A  -SP  +  7- VieoP)  -  ^-^^‘^B2B2S2QSQS:^B'iB2P\'^ 

+  ^2ooX^2Q^QB2  ^2oqX  ~  ^±t/2oo±S2Q^QS2  ^2ooX'’'±  >  (^‘9) 


J 


0  =  (A  -  (P2B2  +  1'2oox)S2QS  +  7”^(:'loo  +  /3^B2B2S2QSQS^B^B2)}'^P 
+  P[A  -  (P2B2  +  i'2cox)S2QB  +  7"*(i'ioo  +  j-^BoBzSiQBQS^B^Bi)] 

+  i/?P(A  -  B2B2S2QS  +  7"^ViooP)r 

+  r^(A  -  B2B2S2QS  +  7"  ViooP)^Pi/2 
+  7"'P(Vloo  +/?'(i'2cox  +  B2B2)S2QSQS^{ty2ooX  +  P2P2)'^]P 
+  V2xPBPv2X  -  r’lv'i^_PSPv2xTx,  (5.10) 


and  let  {Ae,Bc,Cc,Dc,  Q)  be  ^ven  by 


\ 

\ 


Ac  =  r[u2x{A  -  SP  +  ^~^VicoP)  -  t'2ooxS2Qi!]G'^, 

Be  =  rv2^xS2QC'^V2\ 

— r~^b'^  P 

""  -(BJPP2)"^P?P(A  -  B2B2S2QE  -SP  +  7"^ViooP) 


(5.11) 

(5.12) 

(5.13) 


Dc 


Omi  X4' 

-B2S2QC'^V2^\  ’ 


(5.14) 


Q+Q  gpT 

rq  rgpT 


(5.15) 
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Then  (A,  D)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  case,  the  closed- 
loop  treinsfer  function  G(s)  satisfies  the  Hqo  disturbzmce  attenuation  constraint  (5.5)  and  the  H2 
performance  criterion  (2.7)  satisfies  the  bound 

J(A„  Bc,Cc,Dc)  <  tr[(Q  +  Q)Ri  +  QP2P].  (5.16) 

Proof.  The  result  is  dual  to  Theorem  4.1  and  thus  is  proved  in  an  analogous  manner.  □ 

Remark  5.1.  Although  theoretically  the  problem  is  completely  analogous  to  the  singular 
measurement  case  there  is  a  diflference  in  the  physical  interpretation.  Using  a  static  gain  for  a 
noise-free  output  is  sound  engineering  practice,  whereas  allowing  the  variance  of  certain  inputs  to 
be  infinite  because  they  are  not  weighted  is  not.  In  the  case  of  actuator  dynamics,  however,  this 
may  be  justified  because  ti  represents  the  command  to  the  actuator. 

6.  Directions  for  Further  Research 

Several  generalizations  remain  to  be  explored.  These  include 

1)  Cross  weighting  and  cross  correlation  of  the  plant  and  measurement  disturbance, 

2)  direct  transmission  terms  in  the  plant  dynamics  and  feedforward  terms  from  disturbances  to 
both  H2  and  Hoo  performance  variables, 

3)  the  general  H2/H00  problem  with  both  types  of  singularities  included  as  shown  in  Figure  3, 

4)  and  finally,  the  connection  of  the  present  results  to  the  mixed  performance/robustness  weighted 
sensitivity /complimentary  sensitivity  problem. 

The  extension  mentioned  in  (3)  has  been  studied  in  [12]  for  the  H2  case. 
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